The Nazi flag with its swastika  was 'borrowed' from the Hindu and Buddhist religions. Hitler was into those  religions   and the Hindu 'caste' system appealed to him, so does that mean we blame the Hindu's or the Buddhists for Hitler?  Even though the  'caste' system  harmonizes nicely with Hitler's own  ideas of a superior, master race, I don't think a majority of  either Hindu's or Buddhists would support Hitler. 
.
Trump in no way, shape or form supports Nazi's, or their flag and neither do most  of his supporters. There may be some Nazi's who claim to support him, there are also many psycho's  who claim to support Democrats as well. Does that mean Democrats support them? 
.
 Saying there were some fine people at a protest march is making a logical assumption that not everyone in a crowd  is an evil Nazi.. I like it that our President assumes there are some good people and not everyone there that day was  a  Nazi sympathizer.  Some were, no doubt,  only there to spectate...