Correct. I have never in my life insulted anybody because of their race. However, in China I am a foreign devil, in Arab countries I am an Infidel and around dark skinned people I am Whitey. 
Its quite annoying that we are the least racist people in the world and yet we are seen as the most racist. 
Being a Scot, I am used to it because the English always say that I am cheap. I am not - I am simply frugal.