"culture, language, and clothing".  I do believe it's related to their religion.  For instance go ask a follower of Orthodox or Hasidic Judaism.  Heck just go down to the Kenai.  Gray people, wearing gray clothes equals unwanted attention as long as you keep your mouth shut also.