Brocket Hall early held variously of Hatfield Manor and the Bishop of Ely. Sir Matthew Lamb's son was Peniston Lamb, 1st Viscount Melbourne and he was often visited at Brocket Hall by the Prince Regent, who had a liaison with Lady Melbourne. The next owner was William Lamb, 2nd Viscount Melbourne, who was Queen Victoria's first Prime Minister from 1835–41, when she regularly visited. His wife, Lady Caroline, infamously had an affair with Lord Byron causing Lord Melbourne much embarrassment. For one of his birthdays she held a state banquet in the Saloon, at which she had herself served from a large
William Cowper-Temple, 1st Baron Mount Temple William Cowper-Temple, 1st Baron Mount Temple William Francis Cowper-Temple, 1st Baron Mount Temple PC (13 December 1811 – 16 October 1888), known as William Cowper (pronounced "Cooper") before 1869 and as William Cowper-Temple between 1869 and 1880, was a British Liberal statesman. Born at Brocket Hall, Hertfordshire, Cowper was the second son of Peter Cowper, 5th Earl Cowper, and the Hon. Emily Lamb, daughter of Peniston Lamb, 1st Viscount Melbourne (since his mother had several lovers there is some doubt about his true paternity). He was the younger brother of George Cowper, 6th Earl Cowper and nephew of Prime Minister