She divorced Arthur Carter in 1977, and married Broadway and TV actor George Hearn the same year. Two years later, in 1979, she divorced Hearn. She married for the third time on May 27, 1984, to Hal Holbrook (14 years her senior), who is most noted for his appearances as Mark Twain. Carter renovated her old family home in McLemoresville with the designs of architect Hoyte Johnson of Atlanta.