Rivers was born in Brooklyn, New York City. She was raised in Larchmore, New York. Rivers studied at Connecticut College and at Barnard College. Similar to how Phyllis Diller career began, Rivers' comedy act was mainly about bad things about herself.