I agree with much of what you said, but many of the counter protesters why not there to do violence (some were). However, white supremacy and nazism has at its very core violence against minorities and those that support integration. because violence is the only way they can achieve their goals. Hate speech is defined differently than other forms of speech.