Seldes was married to Julian Claman from 1953 until they divorced in 1961. Her marriage to Julian was abusive. Seldes left the marriage after her father noticed marks on Seldes's face. Then she was married to Garson Kanin from 1990 until his death in 1999. She had one daughter with Julian, Katherine. 