How does "xenophobe ", "colonialist", "misogynist" or "homophobe" and even " Black Lives Matter" compare? Each of those words is attached to values and belief systems  that actually are relevant in a discussion. If the shoe fits maybe it's time to think about why you're uncomfortable about those labels .....
If you're serious about discussion then challenge the idea, don't try to insult your way out of it.