It's not xenophobic to fear fundamentalist Muslims. Their holy book teaches them not to love they neighbor but to convert that neighbor and impose the medieval system of oppression known as sharia law.
Let's say that the terrorist are a small minority of fanatics.
Why do they always quote their holy book, the Quran, when they do the most heinous acts you could ever imagine? Raping, murdering, kidnapping, cutting peoples heads off, crucifying them in public squares, putting them into a cage, setting them on fire are all in the name of religion!