Hughes was born in Sydney, New South Wales. His brother was critic and writer Robert Hughes. Hughes has three children. His daughter, Lucy, was Lord Mayor of Sydney and is married to former Prime Minister Malcolm Turnbull.