He was elected to the 51st and 52nd United States Congresses, holding office from March 4, 1889, to March 3, 1893. Afterwards he returned to the State Senate where he sat from 1895 until his death, being a member of the 118th (26th D.), 119th, 120th, 121st, 122nd, 123rd, 124th, 125th, 126th, 127th, 128th, 129th, 130th, 131st and 132nd New York State Legislatures (all 42nd D.); and was President pro tempore from 1903 until his death. He was an alternate delegate to the 1900 and 1904 Republican National Conventions.