We do, I think, have a major theological problem with denying ordination to women on bodily appearance, since the early church taught that in the incarnation, Christ assumed all of humanity. "What is not assumed, is not saved" was a commonly shared belief among those debating the nature of the incarnation.  It seems to me that we have a rather stark choice: either Christ's incarnation was a specific male incarnation or it was a taking on of the fullness of humanity. The doctrine of the incarnation seems to me to disallow any gender-specific categorization.