Brocket Hall early held variously of Hatfield Manor and the Bishop of Ely. Sir Matthew Lamb's son was Peniston Lamb, 1st Viscount Melbourne and he was often visited at Brocket Hall by the Prince Regent, who had a liaison with Lady Melbourne. The next owner was William Lamb, 2nd Viscount Melbourne, who was Queen Victoria's first Prime Minister from 1835–41, when she regularly visited. His wife, Lady Caroline, infamously had an affair with Lord Byron causing Lord Melbourne much embarrassment. For one of his birthdays she held a state banquet in the Saloon, at which she had herself served from a large
William Lamb, 2nd Viscount Melbourne support a government. Melbourne was the man most likely to be both acceptable to the King and hold the Whig party together. Melbourne hesitated after receiving from Grey the letter from the King requesting him to visit him to discuss the formation of a government. Melbourne thought he would not enjoy the extra work that accompanied the office of Premier, but he did not want to let his friends and party down. According to Charles Greville, Melbourne said to his secretary, Tom Young: "I think it's a damned bore. I am in many minds as to what to do". Young