After women's suffrage was achieved, Goldstein remained prominent as a campaigner for women's rights and various other social reforms. She was an ardent pacifist during World War I, and helped found the Women's Peace Army, an anti-war organisation. Goldstein maintained a lower profile in later life, devoting most of her time to the Christian Science movement. Her death passed largely unnoticed, and it was not until the late 20th century that her contributions were brought to the attention of the general public.