Brocket Hall early held variously of Hatfield Manor and the Bishop of Ely. Sir Matthew Lamb's son was Peniston Lamb, 1st Viscount Melbourne and he was often visited at Brocket Hall by the Prince Regent, who had a liaison with Lady Melbourne. The next owner was William Lamb, 2nd Viscount Melbourne, who was Queen Victoria's first Prime Minister from 1835–41, when she regularly visited. His wife, Lady Caroline, infamously had an affair with Lord Byron causing Lord Melbourne much embarrassment. For one of his birthdays she held a state banquet in the Saloon, at which she had herself served from a large
William Ward, 3rd Viscount Dudley and Ward John, who served as Foreign Secretary and was created Earl of Dudley in 1827. William Ward, 3rd Viscount Dudley and Ward William Ward, 3rd Viscount Dudley and Ward (21 January 1750 – 25 April 1823) was a British peer and politician. Ward was the son of John Ward, 1st Viscount Dudley and Ward, by his second wife Mary (née Carver). He was elected to the House of Commons for Worcester in 1780, a seat he held until 1788, when he succeeded his half-brother in the viscountcy and entered the House of Lords. He married Julia, daughter of Godfrey Bosvile, in