William Berkeley, 1st Earl FitzHardinge refused to claim his right to the earldom. In 1831 William Berkeley was raised to the peerage as Baron Segrave, of Berkeley Castle in the County of Gloucester. Berkeley was returned to parliament as one of two representatives for Gloucestershire in 1810 (succeeding his uncle Sir George Cranfield-Berkeley), a seat he only held until 1811. In 1836 he was appointed Lord-Lieutenant of Gloucestershire, a post he retained until his death. In 1841 he was further honoured when he was made Earl FitzHardinge. Berkeley never married. He had several mistresses, and in 1821 John Waterhouse succeeded in an action for "criminal
Thomas de Berkeley, 5th Baron Berkeley including in 1395 when he served jointly with Gilbert Denys. Nigel Saul states that such feoffees were likely to have been members of Lord Berkeley's retinue. These were very significant positions of trust granted to his feoffees as Berkeley died leaving only a daughter and the succession to the vast Berkeley lands, including the castle itself, became a matter of much dispute amongst his possible heirs resulting in a series of feuds which led in 1470 to the last private battle fought on English soil at the Battle of Nibley Green, between Lord William Berkeley and Viscount Lisle, and there