As a guy I have no problem who is using men's  washroom, but I can imagine that ladies may have an issue with it.  Realistically, the percentage of trans-gendered people is so mall that you have almost a zero chance of bumping into one in a washroom.