 Phelps served as judge of the superior court of Connecticut from 1863 to 1873.He served as judge of Connecticut's supreme court of errors from 1873 until his resignation in 1875.Phelps was elected as a Democrat to the 44th and three succeeding Congresses (March 4, 1875 – March 3, 1883).