If someone has had surgery to alter their gender, then I think its fine that they use the washroom of their new gender. 

But a person with a 5 o'clock shadow sporting a twig and berries walking in a woman's washroom or pool locker room because they feel like a woman is patently ridiculous.