How can someone who is "committed to social justice" support a system that gives powers of spiritual authority to men or women?

If the office of clergy is itself a morally wrong system,  a conference of illegitimate authority over an un-ordained laity, then isn't bringing women into this system just compounding social injustice?