 He was not a candidate for renomination in 1890 and resumed the practice of law at Dover.Penington died at Dover and is buried there in the Old Presbyterian Cemetery, on the grounds of the Delaware State Museum.Penington's last years were darkened by the murders of his daughters Elizabeth and Ida, by poisoned candy.