Once people feel their freedom to be heard is compromised, they are likely to move towards more extreme ends by meeting in secret groups and amplifying each others' thoughts. Redefining oneself as an extremist organization can be more harmful than the influence of free speech.
Hateful organizations will go underground and foster unfettered hate among their members.