Anti-semitism is being hostile to an ethnic group, Islamophobia is being hostile to an ideology, i.e. Islam.

It is similar to the difference between being anti-Zionist, i.e. against an ideology or certain policies, and being anti-semitic, i.e. hostile to an ethnic group (i.e. whether they are religious or zionist or not).