The house has had many extensions and changes over the centuries, including the addition of a racquets court in the 18th century, the final addition being the West Library which was added by the family of Leopold C. D. Jenner who occupied the house in the early 20th century and completely redesigned the gardens. The house was leased and restored by Alexander Keiller, heir to the James Keiller & Son marmalade business, who took an intense interest in Avebury henge in the late 1930s.