The estate passed through several owners until 1650 when it was sold to Sir Purbeck Temple, a member of the Privy Council in the time of Charles II. After the death of Sir Purbeck in 1695 and his wife Dame Sarah Temple in 1700, the estate passed to Dame Sarah's nephew, William Draper, who was married to the daughter of the famous diarist, John Evelyn. When Draper died in 1718, he left his estate to his son of the same name and it then passed to his nephew, Charles Clark.