The last direct descendant of the Durbans to own the castle was Joseph de Gléon, Baron of Durban, who died aged 82 without heirs in 1787. The last inheritor of the castle sold it in 1873 to Paul Combes, who intended to use the stone as building material and had destroyed large parts of the structure by the end of the 19th century.
The sequence of events led to Joseph de Gléon, Baron of Durban, being the last direct descendant to own the castle, which he passed away in 1787 without any children. The castle was subsequently sold to Paul Combes in 1873, who had plans to use the stone for construction purposes and eventually destroyed a significant portion of it by the late 19th century.