Montagu was born in London. His father, John, died when Edward was aged two in 1929. He was married twice, first to Belinda Crossley and later to Fiona Margaret Herbert. He had three children, two sons and a daughter.