The castle was purchased from the Wollaston family in 1788 by Clement Winstanley. In 1790, the remains of the north tower were still standing, albeit in very poor condition. Clement Winstanley reportedly wanted to pull the northern ruins down, intending to reuse the bricks to make a barn, but his son, also called Clement, intervened, and subsequently carried out repairs to the castle. By the 19th century the ruins were covered in ivy; by the early 20th century, trees were growing out of the tops of the walls, which were frequented by grazing goats and cattle. Much of the moat had silted up and the remains of the bridge had been buried by the accumulated debris.