It probably is religion.  But that points to bad choices from people coming here.  If you want to wear a Muslim burka everyday, you'll be happier in a place where that is normal.  Don't come to some place where that is strange and not expect to have people look at you.  I bet if I put on an Eskimo parka and went to London I would get some strange looks from people, not hate but certainly a WTF.