Frank belongs to the Pitjantjatjara nation. He was born at a waterhole near Kaltukatjara, in the Northern Territory. He has seven older brothers. Frank's father was Isaac Yamma, a country singer who was one of the earliest musicians in Australia to become well known singing Western-style songs in a native language. Frank grew up in Alice Springs and played in a band with his brothers from an early age.