In 1941, Fitzgerald married Benny Kornegay, a convicted drug dealer. The marriage was annulled after two years. In December 1947, she married double bass player Ray Brown. They adopted a child of Fitzgerald's half-sister, Frances. They named him Ray Brown, Jr.. Fitzgerald and Brown divorced in 1953.