The fact that so few Americans owned slaves just means that the rich whites, as usual, used the draft and divide and conquer strategy to get poor white Southerners to fight their Secessionist battle for them. Slave owners were able to buy their way out of service. Not poor white Southerners. Over and over in this country, white supremacy was trotted out to get poor white Americans to accept crumbs rather than unite with their fellow black Americans. Poor white Americans were used to chase escaped slaves they themselves could never afford. Poor white Americans were used to segregate and terrorize freedmen who only wanted liberty. Poor white Americans were used to enforce Jim Crow the 20th century. 

The more things change, the more they stay the same. 

The stats you cited provide even more reason to toss the racist divisive Confederacy into history's trash bin. Let's stop celebrating poor whites being duped to fight for slavery. 

Fulfill the ideals of Reconstruction, at long last.