I think you can read this situation as well as anyone else TTT, you just want to make it an issue because you seem to see it as a matter of choice, when it's not, it's a matter of law.
The gentleman has the same rights as anyone else offering a service - he is entitled to refuse without giving a reason. Now that reason maybe because he is a racist, but you can't be prosecuted for what you think (yet!) so he can simply stay silent and remain within the law.
One of the main problems with bigotry is that it often goes hand in hand with arrogance - it's not sufficient for you simply to be a small-minded nasty ignorant twonk, you have to make the world aware of that fact, in loud voice, usually by advising the said world that you are someone who 'believes in plain speaking'.
This man is a bigot, which is his own affair, but he makes his bigotry the subject of his loud mouth, and that makes it the law's affair as well.
If he could learn to dial down the arrogance and simply be a bigot on the quiet, no-one would know, and he could, as suggest, let his properties to who he wants.