Uh, yeah, they were assaulting people, throwing rocks and other projectiles, deploying pepper spray on anyone and everyone.  They were violent agitators.  Your idea of these other groups consisting of innocent "old ladies" and "church ladies" is a complete fiction that can be disproved by a Youtube search.  One side wanted to shut down free speech and they accomplished their objective by creating turmoil.