Ross married Judith Nodine in 1961. They had two daughters. Ross and Nodine divorced in 1995. His second wife was former New York Lt. Governor Betsy McCaughey. They married in 1995 and divorced in 2000.