It comes down to his refusal to participate in a gay marriage. As he has plainly stated, he will sell any cake he has to anyone who wants one. 

DP has a story indicating they got to some design specifics, since the cake was to have a rainbow decoration.