The site has been occupied since Elizabethan times, when a large manor house was constructed. This was replaced in 1771 by a Georgian mansion for the owners, the Hoste Henleys. In 1836 Sandringham was bought by John Motteux, a London merchant, who already owned property in Norfolk and Surrey. Motteux had no direct heir, and on his death in 1843, his entire estate was left to Charles Spencer Cowper, the son of Motteux's close friend Emily Temple, Viscountess Palmerston. Cowper sold the Norfolk and the Surrey estates and embarked on rebuilding at Sandringham. He led an extravagant life, and by the early 1860s, the estate was mortgaged and he and his wife spent most of their time on the Continent.