 In 1868, he was appointed United States Attorney for the district of Delaware by President Andrew Johnson and served until 1872.He was appointed Delaware Attorney General by Governor Ponder in 1874 and served until 1879.Penington was elected as a Democrat to the 50th and 51st Congress, serving from March 4, 1887, to March 3, 1891.