Pung was born in Footscray, Victoria and raised in Braybrook. Her parents were immigrants living in Cambodia. They fled to Australia during Pol Pot's Khmer Rouge regime in 1980. She was born one month after the event. She is the oldest of four siblings.