Barkley was born in Keytesville, Missouri. Her father was a lawyer. Her mother was a pianist who had studied in Europe. She married her first husband, Carleton Hadley, in 1931. She met him at Washington University in St. Louis, Missouri. He became a prominent railroad attorney. They had two daughters. He died in 1944 at the age of 42.