Goodes was born in Wallaroo, South Australia. His father is of English, Irish and Scottish ancestry, and his mother is an Indigenous Australian (Adnyamathanha and Narungga). From the age of four, he was raised by his mother. He grew up in Wallaroo and Adelaide, South Australia, and Merbein, Victoria. His brother, Brett, is also a former Australian rules player. He is married to Natalie Croker.