It is said that the castle was in a state of advanced decay at the end of the 18th century. Several buildings were demolished and rebuilt during the 18th and 19th centuries. Two prominent 19th-century transformations were: the demolition of the Église Saint-Maimbœuf in 1810; and the destruction of the house called ""entre les tours"" (between the towers), which was a building flanked by the Henriette and Frederique towers characterising "Châtel-Derrière" that gives the castle its imposing aspect. This house was replaced by a facade decorated with spires in the Germanic style of the 17th century.