The reason people do not have to make a cake with Nazi symbols is because political thought is not protected.
Offensive has nothing to do with it.

The baker chooses to be offended once he learns the cake is for a gay wedding. 
If he does not know the cake is for a gay wedding he is not offended. 

Choosing to be offended and dumb religious views are not a license to discriminate.