There are various follies on the estate. To the east of the house is the Temple of Diana, erected before 1743 with Ionic order columns from Devonshire House in Piccadilly, which had burnt in 1733, and remodeled by Barry. "Heaven's Gate" is a folly about 60 feet high on Sidown Hill, built in 1749 by Hon. Robert Sawyer Herbert (d. 1769). Other 18th-century follies that can be found on the grounds of the estate include Milford Lake House and Jackdaw's Castle, both attributed to the architect-earl of Pembroke, brother of the owner, and the Etruscan Temple.