Ball was born to Henry Durrell Ball (September 16, 1887 – February 19, 1915) and Desiree "DeDe" Evelyn Hunt (September 21, 1892 – July 20, 1977) in Jamestown, New York. Her family was Baptist. She was of French, Scottish, English, and Irish ancestry. She had a brother Fred Henry Ball (July 17, 1915 – February 5, 2007).