A native of Benoit, Mississippi, Moore was raised in St. Louis, Missouri, and grew up in poverty. Moore was denied a shot at the world title for over ten years, and spent many of those years fighting on the road with little to show for it. An important figure in the American Black community, he became involved in African American causes once his days as a fighter were over. He also established himself as a successful character actor in television and film. Moore died in his adopted home of San Diego, California; he was 84 years old.