Brocket Hall early held variously of Hatfield Manor and the Bishop of Ely. Sir Matthew Lamb's son was Peniston Lamb, 1st Viscount Melbourne and he was often visited at Brocket Hall by the Prince Regent, who had a liaison with Lady Melbourne. The next owner was William Lamb, 2nd Viscount Melbourne, who was Queen Victoria's first Prime Minister from 1835–41, when she regularly visited. His wife, Lady Caroline, infamously had an affair with Lord Byron causing Lord Melbourne much embarrassment. For one of his birthdays she held a state banquet in the Saloon, at which she had herself served from a large
Elizabeth Lamb, Viscountess Melbourne Elizabeth Lamb, Viscountess Melbourne Elizabeth Lamb, Viscountess Melbourne (née Milbanke; 1751 – 1818) was one of the most influential of the political hostesses of the extended Regency period, and the wife of Whig politician Peniston Lamb, 1st Viscount Melbourne. She was the mother of William Lamb, 2nd Viscount Melbourne, who became Prime Minister of the United Kingdom, and several other influential children. Lady Melbourne was known for her political influence and her friendships and romantic relationships with other members of the English aristocracy, including Georgiana Cavendish, Duchess of Devonshire, Francis Russell, 5th Duke of Bedford, and George, Prince of Wales.