Johnny Walker has ruled out fighting his half-brother, Valter Walker, in the Ultimate Fighting Championship.