Lithgow was born on October 19, 1945 in Rochester, New York and studied at Harvard University. Lithgow was married to Jean Tayton from 1966 until they divorced in 1980. Lithgow has been married to Mary Yeager since 1981. Lithgow has three children, Ian, Phoebe, and Nathan Lithgow.