Cole earned more money and moved to California. He bought a house in an area where white people lived. At that time, many white Americans did not want to live near blacks. White home owners nearby protested the purchase of a house by a black family. Cole and his family refused to leave and lived in the house without problems.