All the buildings inside the walls were swept away in the 1770s to make way for a new courthouse, which was extended by the addition of wings in 1895 and 1905. Because of its function as a court, the interior of the castle was not open to the public until the court moved to a new site in 2004. The entire site was later sold to a developer whose stated aim was to transform it into "the Covent Garden of the South West".