"MAYBE being a male or female goes beyond simply having a certain type of genitalia?"

Absolutely.  In addition to the genitalia, there is an enormous amount of cultural programming.
It is difficult to believe that Jesus placed much value in the spirituality of cultural programming, but if the bishops say it is so, then it must be so.