Islamic rulers (Ottomans, among others) came up with this idea first.  I guess that makes it okay because  they imposed it on whitey (Balkan Christians, and presumably any other infidels that came under their rule).