No one is trying to get men into the ladies' room. They're trying to get women out of the men's room, and vice versa. So this is really exactly what you want - men in the men's room, women in the women's room.  A trans woman is a woman. A trans man is a man. Grasp the concept.