First of all, the political correctness movement will point out that "all men" should be changed to "all humans". Secondly, women have more legal rights than men in entire North America even if officially we like to say that we have "equal rights". More women are admitted into colleges and universities, affirmative action is not available to whites, black lives matter does exists, as do white supremacists. So, if you do ask the president that question, he will say "many sides" just like 2 days ago, and he would be correct. 
Who really follows and values the charter in Canada? It is abused daily, and those who can claim victimhood (not real and actual victims) the most, win and get to violate it.