Woodson was born to James and Eliza Riddle Woodson in Buckingham County, Virginia. He was a famous African-American historian, journalist, author, and founder of the Association for the Study of African American Life and History.