If large, affluent population centers tended to vote one way, and rural places voted another (they do), without the electoral college, we'd always have "The Capitol" in control, and perpetual servitude from "The Districts."
Did that just ruin the Hunger Games for all the Clinton Elitists?
All votes should matter, but only to the extent that state-by-state results are decided. An uneven playing field can build the temptation to fix votes, peddle influence, gerrymander, et cetera, et cetera, et cetera. A national majority vote would unfairly favor economic elites (Super PACs, think tanks, big money and urban interests) and disadvantage average voters more so than what now exists. 
See the findings of Gilens and Page, 2014.
http://journalistsresource.org/studies/politics/finance-lobbying/the-influence-of-elites-interest-groups-and-average-voters-on-american-politics

Face it: If the shoe were on the other foot, it would be Liberals whining. Hypocrisy is usually the province of the loser.