"But he should not have even be subject to that because it's not against the law to be anti-Semitic."

No it's not against the law to be anti-Semitic or Islamophobic or any other hateful state of mind. But that doesn't mean that all words and actions arising from those hateful states are legal.