Being Transgender is not solely about surgical procedures to "plumbing". Please research on hormone therapy, which does have impacts on regions of the brain and therefore effects sex drive and impulse control.
Why are you trying to force people who look like men, and have significantly more testosterone than most men, into women's restrooms?