In 1771 the original house was damaged in a fire; Thomas Rumbold purchased the estate in 1774. He demolished the remnants of the house and built a new one devised by Thomas Leverton in 1777. This neo-classical house is still extant, although it was enlarged some years later. The house with the surrounding land was then purchased by Samuel Smith (1754–1834), a banker and a Member of Parliament, from Nottingham, in 1801. Four generations of Smiths occupied the house until 1930 after the death of the fourth, Colonel Abel Henry Smith. The contents of the house were dispersed and it became a school, later called Heath Mount School, in 1934.