Brocket Hall early held variously of Hatfield Manor and the Bishop of Ely. Sir Matthew Lamb's son was Peniston Lamb, 1st Viscount Melbourne and he was often visited at Brocket Hall by the Prince Regent, who had a liaison with Lady Melbourne. The next owner was William Lamb, 2nd Viscount Melbourne, who was Queen Victoria's first Prime Minister from 1835–41, when she regularly visited. His wife, Lady Caroline, infamously had an affair with Lord Byron causing Lord Melbourne much embarrassment. For one of his birthdays she held a state banquet in the Saloon, at which she had herself served from a large
Viscount Palmerston Viscount Palmerston married the Honourable Emily Lamb, sister of Prime Minister Lord Melbourne and widow of Peter Clavering-Cowper, 5th Earl Cowper. Emily's second son from her first marriage, the Honourable William Cowper, inherited parts of his stepfather's estates, including Broadlands near Romsey in Hampshire, and assumed the additional surname of Temple. In 1880 he was raised to the peerage as Baron Mount Temple, a revival of the junior title held by the Viscounts Palmerston. He was childless and the peerage became extinct on his death in 1888. However, it was revived once again in 1932 in favour of his great-nephew,