Possible but highly unlikely.  It's true that the swastika has been around for a long time -- even Rudyard Kipling had it on the flyleaf of his first editions; this was before the mustachioed dictator, of course.

But most of the miscreants that adorn themselves in Nazi themed regalia do it solely for shock value.  Almost to a man, they have little to no knowledge of history or culture.  It's why the 1%ers (outlaw bikers) are fond of it, and why Sid Vicious of the Sex Pistols was often seen in a swastika T-shirt.

These people are not Nazis.  They are morons.  

And Mr Eddy was quite wrong in his advice.  The best way to treat an offensive moron is with silence.

The kind of person who would get a swastika tattoo or wear the SS death's head insignia would take great pleasure in your displeasure.

Don't give him the satisfaction.