The harm you describe is not one sided. Being "mocked or vilified" happens to both side from both sides. The national debate about cakes is in fact about rights. Do the government have the right to force someone to labor? Suggesting that a gay would not be able to acquire a cake because one baker did not want to make is is false and as such, aside from felling like you are not liked by said baker, there is no harm. If you want to see harm, force a baker to make you a cake and then imagine what said baker did to it while you were not looking. I will take my business to someone who wants it.