The present building was designed and built around 1720 by its owner, Sir William Wentworth assisted by James Moyser to replace the earlier hall. In 1792 it passed into the Beaumont family, (latterly Barons and Viscounts Allendale), and the library and dining room were remodelled by John Carr in 1793. Monumental stables designed by George Basevi were built between 1842 and 1852. The hall was sold to the West Riding County Council in 1947. Before the sale, the panelling of the "Henry VIII parlour" (preserved from the earlier hall) was given to Leeds City Council and moved to Temple Newsam house.