Of course, to NOT be white and male DID, for much of our history, deprive women and people of color of full citizenship.  To point this out is not to be racist or sexist. It's to be well-informed and realistic.

Also, I can't resist pointing out that the rich simply did NOT rule "always rule" the First Nations for whom Columbus marked the beginning of the end. Many, even most, of those societies appear to have been robustly egalitarian. It's revealing that you seem to have overlooked this, given the current context.