In theory, yes. Religious types say they can't make a cake for a gay couple because it violates their beliefs. These venues kicking out white supremacists are doing the same thing, denying their services to those they don't agree with.
I'm simply using the alt-right's logic against them. They cry "discrimination!" or "censorship!" when a venue kicks out a hate group, but see no hypocrisy in doing the same thing to gays.
(Apparently I've been misunderstood. It's dismaying to see Archie Bunker agreeing with me.)