Rumsey was elected as a Whig to the Thirtieth and Thirty-first Congresses, holding office from March 4, 1847, to March 3, 1851. He was a delegate to the New York constitutional convention in 1867 and was a member of the commission to propose amendments to the State constitution in 1872.
Rumsey was a Whig representative for the Thirtieth and Thirty-first Congresses, serving from March 4, 1847, until March 3, 1851. He attended the New York constitutional convention in 1867 and served on the commission to propose amendments to the State constitution in 1872.