Not sure what the number of slave owners prior to the civil war has anything to do with the number of violent actions taken by a group that didn't form until after the civil war.  Nevertheless, lumping the non-slave owning and much more populous north with the south is specious.  Here is a longish article:

http://www.history.com/news/history-lists/5-myths-about-slavery

There in is stated: "The 1860 census shows that in the states that would soon secede from the Union, an average of more than 32 percent of white families owned slaves."

It is estimated that in 2016 KKK membership (not counting the many other groups of White Nationalism) was about 8000.  The concern is that a movement like "unite the right" is trying to persuade other previously non-violent Alt-Righers into the KKK and associated fold.

Finally, where have I "bashed" whites in general? Please specify.