Pizer was born in Melbourne, Victoria. She studied literature at the University of Melbourne. She lived most of her life in Sydney, New South Wales. Her husband was Muir Holburn, who died in 1960. They had two children.