When Charles II was restored to the throne in 1660, Bennett was removed from his post as constable. He was initially replaced by Thomas Rosse and then, in 1661, by Philip Piper. A gaol was built in the centre of the bailey in the late-17th century; it was bought by the constable and was adopted as the county gaol. In 1690, the county complained to the King that the constable, Sir Hugh Pyper, had allowed it to fall into disrepair and that the male and female prisoners were sleeping together in the same quarters. Two years later, the Crown granted the post of constable in perpetuity to Hugh and for two generations after him; in exchange, Hugh agreed to invest £120 in repairing the facility. The bailey was also used for carrying out executions.