He served as a member of the Vermont State Senate from 1892 until 1894. Foster was the first president of the Young Men's Republican Club of Vermont, which was organized in 1894. He was state tax commissioner from 1894 until 1898.
Foster held various roles in Vermont politics, including serving as a senator from 1892 to 1894. He also played a key leadership role with the Young Men's Republican Club of Vermont, which he helped establish in 1894. Later, he served as state tax commissioner from 1894 to 1898.