 Sargent was a trustee of the New York Public Library, the New York Zoological Society and the American Academy in Rome.He died in 2012, aged 87, after recent years of frail health following a stroke.He was survived by, among others, his wife Elizabeth, two children and grandchildren, and two stepchildren.