After the death of the last Braose of Radnor the castle was taken into royal or crown custody but was destroyed by Prince Llywelyn ab Iorwerth in 1231. In 1233 it was illegally rebuilt by Richard, 1st Earl of Cornwall and then passed to the young Roger Mortimer of Wigmore Castle. In 1264 Prince Llywelyn ap Gruffudd allied with Simon de Montfort, 6th Earl of Leicester took and again destroyed the castle. In all the castle had changed hands twelve times in only eighty years. On four of these occasions the castle was said to have been 'destroyed'.