On August 13, 1930, Walter David and Addie Turner Mizell welcomed their son Wilmer David into the world. Contrary to popular belief because of his nickname, Wilmer was actually born and raised in Leakesville, Mississippi. His father died when he was two, and his grandmother and uncle brought him up, as his mother was sickly. He grew up laboring on the family farm, which produced fruit and vegetables. The Mizells also raised hogs and cattle. Additional income for Wilmer came from hauling wood, logging, and tapping turpentine from pine trees. "I walked behind more mules than I walked batters – and that's saying a lot," he compared his childhood with his career.