Symington was married to Evelyn Wadsworth. Their marriage would last until her death in 1972. Symington resigned in 1976, four days before his term would end. They had one son, James W. Symington, former member of the United States House of Representatives. His cousin, Fife Symington, served as Governor of Arizona from 1991 through 1997.