Yilpi was born at a place near Uluru, in the Northern Territory. Her mother was a member of the Pitjantjatjara people and her father was Yankunytjatjara. When Yilpi was still very young, her parents came to live at Ernabella, a Presbyterian mission in northwest South Australia. She grew up there, and later began working at Ernabella Arts.