In 1939, Dixon was a founding member of the Five Breezes, with Caston, Joe Bell, Gene Gilmore and Willie Hawthorne. The group blended blues, jazz, and vocal harmonies, in the mode of the Ink Spots. Dixon's progress on the upright bass came to an abrupt halt with the advent of World War II, when he refused induction into military service as a conscientious objector and was imprisoned for ten months. He refused to go to war because he would not fight for a nation in which institutionalized racism and racist laws were prevalent. After the war, he formed a group named the Four Jumps of Jive. He then reunited with Caston, forming the Big Three Trio, which went on to record for Columbia Records.