In 1903, Goldstein unsuccessfully contested the Senate as an independent, winning 16.8 percent of the vote. She was one of the first four women to stand for federal parliament, along with Selina Anderson, Nellie Martel, and Mary Moore-Bentley. Goldstein ran for parliament a further four times, and despite never winning an election won back her deposit on all but one occasion. She stood on left-wing platforms, and some of her more radical views alienated both the general public and some of her associates in the women's movement.