William Berkeley, 1st Earl FitzHardinge refused to claim his right to the earldom. In 1831 William Berkeley was raised to the peerage as Baron Segrave, of Berkeley Castle in the County of Gloucester. Berkeley was returned to parliament as one of two representatives for Gloucestershire in 1810 (succeeding his uncle Sir George Cranfield-Berkeley), a seat he only held until 1811. In 1836 he was appointed Lord-Lieutenant of Gloucestershire, a post he retained until his death. In 1841 he was further honoured when he was made Earl FitzHardinge. Berkeley never married. He had several mistresses, and in 1821 John Waterhouse succeeded in an action for "criminal
Margaret Mortimer, Baroness Berkeley Margaret Mortimer, Baroness Berkeley Margaret Mortimer, Baroness Berkeley (2 May 1304 – 5 May 1337) was the wife of Thomas de Berkeley, 3rd Baron Berkeley. She was the eldest daughter of Roger Mortimer, 1st Earl of March, the "de facto" ruler of England from 1327 to 1330, and his wife Joan de Geneville, Baroness Geneville. Margaret Mortimer was the eldest of the twelve children of Roger Mortimer, 1st Earl of March and Joan de Geneville, Baroness Geneville. Her paternal grandparents were Edmund Mortimer, 2nd Baron Mortimer and Margaret de Fiennes. Her maternal grandparents were Piers de Geneville, of Trim Castle