He married socialite Aimee Ernesta Drinker (1892-1981) in 1916. She gave birth to a son in 1917, who died two days later. They divorced in 1923. In 1924 he married Louise Bryant, journalist author of "Six Red Months in Russia" and widow of radical journalist John Reed. Bullitt divorced Bryant in 1930 and took custody of their daughter after he discovered Bryant's affair with English sculptor Gwen Le Gallienne. The Bullitts' daughter, Anne Moen Bullitt, was born in February 1924, eight weeks after their marriage. Anne Bullitt never had children. In 1967, she married her fourth husband, U.S. Senator Daniel Brewster.