I think that you are over-simplifying,
Promoting "some" to "all" is not a valid argument.
*
In this case, one group, the neo-nazis is in an evil class by itself.
But this does not lump everyone on the other side from you in the same class.