It's not actually. Diversity has inherent value. If you only hire cisgender white men, only the ideas, talents, and social backgrounds of cisgender white men will be available to you. Plenty of people take that option because of their subconscious racism/sexism/etc... From a libertarian perspective (one I've heard from libertarians, I'm not a libertarian myself), people who do not take diversity into account are robbing their businesses/organizations/bureaus of the success those varied backgrounds can provide - only thoroughly tapping the potential of about 43% of the population. 
From my own perspective (socialist-ish), a lot of personal "baggage" comes from my heritage (specifically from shit white people have done to my ancestors), and I ask for distributive justice. I'm happy to fight for that same justice for others, if they want an ally.