No, if you called out a Muslim for their intolerant views on same sex marriages, abortion, women's rights or being anti-gay, you shouldn't be accused of Islamophobia.  If you singled out Islam, implying the Old Testament and Torah it was based on aren't filled with the same, you would be.