What you are missing is that men are also sexual assault victims, not just women.  Also our adversarial justice system creates only losers and public spectacles when there are restorative justice options which are better suited for the vast majority of cases.