In 1827, Sir George William Jerningham, 8th Baron Stafford, commissioned large-scale grand and elaborate expansions of Sir Henry's Hall, with many towers and mock-Tudor windows. The project was ongoing over several decades, continued by the 9th Baron Stafford from 1851, and although many features of the new design were realised, completion was ultimately prevented by dwindling funds. The 10th Baron Stafford, who inherited the title in 1884, was certified as a lunatic; during his ownership, the estate was held by the Lunacy Commission. The generous and reclusive Sir FitzOsbert Stafford Jerningham, 11th Baron Stafford, resided at Costessey Hall until his death in 1913, upon which the Hall's contents were auctioned at a high-profile sale.