The house incorporates a Gothic Revival Chapel designed by James Wyatt, completed by Jeffry Wyatt in 1817. The most notable exterior feature of the chapel is its spire which was demolished in 1922 by Lord Brownlow as it had become structurally unsound. The spire which can be seen today is in fact a fibreglass replica which was erected in 1969. The chapel interior features a pair of Fourteenth-Century carved doors, fan-vaulted coving supporting a canted panelled ceiling; a set of carved oak choir stalls designed by Jeffry; and an array of Rayonnant lancet windows. The windows were originally fitted with stained glass panels depicting scenes from the Bible; the glass was imported by the 7th Earl from Germany, having been originally designed in the Sixteenth Century for Steinfeld Abbey and Mariawald Abbey. The glass was auctioned off at Sotheby's in 1928 and acquired by the Victoria and Albert Museum. One glass panel featuring the Blessed Virgin was placed in the nearby Church of Ss Peter and Paul at Little Gaddesden; another, depicting St Peter was in Christ Church, Croydon in London. Beneath the chapel is a vaulted medieval wellhouse with a well.