I'm a Conservative supporter through and through.

That being said, just because you were yelled at does not make it "racist", "sexist", or "ageist".  Unless he specifically said something in regards to any of those things.

All it means was that he was being a jerk.