Whoever holds more power will ultimately have the upper hand. It works the same way in non-White societies. North Koreans are racist against non-North Koreans. Black Africans are racist against other Black Africans. Japanese are racist against Koreans and vice versa. 

Nothing you said disputes the fact that all people have racist thoughts.