Not all those protesting the removal of confederate monuments are racist or Nazis. Some were just there defending the memory of ancestors that, rightly or wrongly, bravely fought and died in a bad war. Do you protest Vietnam war memorials even though DefSec McNamara admitted was a "terrible mistake," and that there was no attack on the Maddox & Turner Joy in the Tonkin Gulf that LBJ fabricated to get authority to widen the war, leading to tens of thousands more American deaths? 
Would the families of those fallen protest if you called for removal of the Vietnam War Memorial? Lincoln himself was racist, and said if he could preserve the union without freeing the slaves he would do so. He wanted to send all blacks back to Africa. 
https://www.snopes.com/did-lincoln-racism-equality-oppose/
So should be remove all monuments to Lincoln? Will you lead the charge to remove Lincoln's name from schools & streets to show your purity? History often is half-toned, not black & white, so to speak.