Segal has been married three times. He married film editor Marion Segal Freed in 1956, and they were together for 26 years until their divorce in 1983. They had two daughters, Polly and Elizabeth. From 1983 until her death in 1996, he was married to Linda Rogoff, a one-time manager of The Pointer Sisters, whom he met at Carnegie Hall when he played the banjo with his band, the Beverly Hills Unlisted Jazz Band.
Elizabeth
Linda Rogoff