A native of Sharon, Connecticut and the son of a prominent clergyman and educator, Parker was raised in upstate New York, received his education from his father and a series of private tutors, and attended Union College, from which he graduated in 1825. He embarked on a career as a teacher and school principal, which he pursued while studying law. After attaining admission to the bar in 1828, he practiced in Delhi as the junior partner of his uncle, Amasa Parker. Active in politics as a Democrat, Parker served as Delaware County District Attorney from 1833 to 1836. He was a member of the New York State Assembly in 1834 and a regent of the University of the State of New York from 1835 to 1844. He represented Delaware and Broome Counties in the 25th Congress (1837-1839), after which he returned to practicing law until he became a judge.