William Berkeley, 1st Earl FitzHardinge refused to claim his right to the earldom. In 1831 William Berkeley was raised to the peerage as Baron Segrave, of Berkeley Castle in the County of Gloucester. Berkeley was returned to parliament as one of two representatives for Gloucestershire in 1810 (succeeding his uncle Sir George Cranfield-Berkeley), a seat he only held until 1811. In 1836 he was appointed Lord-Lieutenant of Gloucestershire, a post he retained until his death. In 1841 he was further honoured when he was made Earl FitzHardinge. Berkeley never married. He had several mistresses, and in 1821 John Waterhouse succeeded in an action for "criminal
William Berkeley, 1st Earl FitzHardinge petitioner's claim was not made out. William received Berkeley Castle and the other estates by will, and on 2 July, after the adverse decision of the Lords Committee, he claimed a writ of summons as a Baron as Baron by tenure of Berkeley Castle. The claim was fully laid before the Committee for Privileges in 1828 and 1829, but the Lords gave no judgement on the case. The eldest son born after the 1797 Lambeth marriage of the fifth Earl, Thomas Moreton FitzHardinge Berkeley, became on the Earl's death in 1810 "de jure" 6th Earl of Berkeley — however, he