Patton was considered African-American, but because of his light complexion there has been much speculation about his ancestry over the years. One theory endorsed by blues musician Howlin' Wolf was that Patton was Mexican or Cherokee. It is now generally agreed that Patton was of mixed heritage, with white, black, and Native ancestors. Some believe he had a Cherokee grandmother; however, it is also widely asserted by historians that he was between one-quarter and one-half Choctaw. In "Down the Dirt Road Blues", Patton sang of having gone to "the Nation" and "the Territo'", referring to the Cherokee Nation's portion of the Indian Territory (which became part of the state of Oklahoma in 1907), where a number of Black Indians tried unsuccessfully to claim a place on the tribal rolls and thereby obtain land.