"but I certainly don't like being called a racist misogynist all the time."

Interesting, in my entire 50 years on this planet I have never been called either of those things. 

Perhaps some self reflection is in order if you've been addressed as such all the time, rather than blaming it on the "militant" left activism.

Oh and this does not sound like a post from someone in "the middle."