Dixon was born in Vicksburg, Mississippi on July 1, 1915. He learned the blues during his time on prison farms in Mississippi as an early-teenager. Dixon sang bass for The Jubilee Singers, a local gospel group that was often in the program of the local radio station WQBC. He began to change poems he wrote into songs which he sold to local groups.