The present building was commenced by John Parker (1703–1768) of nearby Boringdon Hall, Plympton, and of Court House North Molton, both in Devon, together with his wife Catherine Poulett (1706-1758), a daughter of John Poulett, 1st Earl Poulett. It was completed by his son John Parker, 1st Baron Boringdon (1735-1788), whose son was John Parker, 1st Earl of Morley (1772-1840). The Parker family had risen to prominence in the mid-16th century as the bailiff of the manor of North Molton, Devon, under Baron Zouche of Haryngworth.