Du Bois was married to Nina Gomer Du Bois from 1895 until her death in 1950. Then he was married to Shirley Lola Graham from 1951 until his death in 1963. Du Bois had two children with Gomer and one son with Graham.