You miss the point.  The whole idea of the EEOC and such is to give folks who are already on the bottom of the heap, with the deck stacked against them, a leg up.  Not to give them an outcome, but to give them a boost.  The problem is that too many of us who do have it better than others, see any opportunity presented to someone who is lower on the socio-economic ladder as somehow taking away from us.  That just isn't true.  If anything, we have been artificially holding them down.  

There was a great story I listened to talking about how the GI Bill, post WWII could be used to help purchase a home if you were white, not if you were black.  It looked at the long term economic impacts and how that one decision basically screwed a ton of those returning black vets and their descendants.  The ability to purchase a home on the GI Bill allowed those white vets to pass that wealth on to their children.  For the black vets, not so much, so yeah, the deck has been stacked.