I get it for the umpteenth time.  You don't approve of discrimination but you're okay with letting it happen so you know to take your dollars elsewhere.  But what you don't understand is that your proposed view, if adopted into law, could work manifest hardship in other contexts.

As for your question, the answer is it depends upon the particular facts of the given situation.  Are there women only gyms?  I can't seem to recall any.