The counter protesters to the white nationalists were a mix of black and white people. The particular group of counter-protesters targeted by the driver was Black Lives Matters, so your 80% guess is most likely incorrect (going by the photos)

https://news.vice.com/story/armed-white-supremacists-march-in-charlottesville-state-of-emergency-declared