To me this isn't a freedom of speech issue. No one that I've seen has made the argument that he shouldn't have been allowed to express those views. He should, and does, have to deal with the consequences of expressing those views if they run counter to organizations he represents or is affiliated with. Freedom of speech doesn't mean freedom from consequences of that speech.