Melbourne Hall second Lord Melbourne, Queen Victoria's Prime Minister, was separated from his wife, Lady Caroline Lamb, in 1825, when her liaison with Lord Byron had become notorious. The house passed into the hands of the Cowper family when Emily Lamb, sister of the childless third and last Viscount Melbourne, married the 5th Earl Cowper. (She later married another Prime Minister, Lord Palmerston.) It remained in the Cowper family until Lady Amabel Cowper married Admiral of the Fleet Lord Walter Kerr who made Melbourne the family home in 1906. The current owner Lord Ralph Kerr also owns Ferniehirst Castle in Scotland. He
Elizabeth Lamb, Viscountess Melbourne Sir Peniston Lamb, 2nd Baronet; they married in London on 13 April 1769. The couple lived at Melbourne House in Piccadilly and Elizabeth quickly became a well-known figure in London Whig society. She was apparently untroubled by her husband's infidelity early in their marriage with the actress and courtesan Sophia Baddeley, just as he came to tolerate her numerous love affairs. Peniston was raised to the Peerage of Ireland as Lord Melbourne, Baron of Kilmore, in 1770 and Viscount Melbourne in 1781. As well as Melbourne House, the family had country residences at Brocket Hall in Hertfordshire and Melbourne Hall