Can you be friends with someone who has different views than you? Of course.
Can you be friends with someone who's views are extreme and racially biased? Probably not.
Yes, everyone is entitled to their views, but not to espouse them to the discomfort and distress of others. Remember, the concept of free speech doesn;t allow you to shout 'Fire!' in a crowded theatre.
I am left-wing by nature, one of my closest friends is a Conservative, and we enjoy spirited debates from time to time, but neither of us hold views of such extreme that voicing them would upset the other, and that is where your issue lies.
If you accept that this guy is right-wing, fine. If he upsets and offends you by voicing his views in spite of your differing stance, then that is not a basis for friendship, which must be based on mutual respect or it is without value.