As a baby she visited her great aunt Ellie in Sydney for the first time; Ellie would figure prominently in her early life, as Goff often stayed with her. Goff lived a simple life as a child, given a penny a week by her parents as well as occasional other gifts. Her mother was known for giving Goff maxims and instructions and she loved "the memory of her father" and his stories of life in Ireland. Goff was also an avid reader, later stating that she could read at three years old, and particularly enjoying fairy tales.