Harvey was born in Bellevue Hill near Bondi in Sydney, New South Wales. He was married to Anne and had two children: a daughter (Claire) and a son (Adam). Both of his children went into journalism careers.