Rivlin was of Cornish ancestry. In 1955, she married former Justice Department attorney Lewis Allen Rivlin of the Rivlin family, with whom she had three children; they divorced in 1977. In 1989, she married economist Sidney G. Winter, Jr. 