Keep the statues;  add the context. Add new statues to  honor the  large  numbers were denied their human rights and more than 50% were denied their civil rights.  Some people still are. Change came from hard work, endurance, and putting their life on the line. More change is needed.

Give memorials special consideration. Every person in the war, soldier  and civilian, free or slave, was someone's family. People are not infallible. Honor the dead person; learn from his choices.  Historical figures had imperfect lives. For scientists, it it's easier to honor the science even when the person was not always honorable. 

The battle against hate must end.  Instead of removing history, we need more reminders history is not easy: slaves,  women, lgqt. Make history approachable. 

Read: https://www.washingtonpost.com/local/americas-missing-slave-memorials-its-time-to-truly-acknowledge-our-bloody-past/2017/08/28/9beeb6d4-8c1a-11e7-8df5-c2e5cf46c1e2_story.html?utm_term=.ed372fddf384