With the current system (not mentioned in the U.S. Constitution, but later enacted by 48 states), a small number of people in a closely divided “battleground” state can potentially affect enough popular votes to swing all of that state’s electoral votes. 

537 votes, all in one state determined the 2000 election, when there was a lead of 537,179 (1,000 times more) popular votes nationwide.