Throughout the First World War Goldstein was an ardent pacifist, became chairman of the Peace Alliance and formed the Women's Peace Army in 1915. She recruited Adela Pankhurst, recently arrived from England as an organiser. In 1919 she accepted an invitation to represent Australian women at a Women's Peace Conference in Zurich. In the ensuing three-year absence abroad her public involvement with Australian feminism gradually ended, with the Women's Political Association dissolving and her publications ceasing print. She continued to campaign for several public causes and continued to believe fervently in the unique and unharnessed contributions of women in society. Her writings in later decades became decidedly more sympathetic to socialist and labour politics.