William Berkeley, 1st Earl FitzHardinge refused to claim his right to the earldom. In 1831 William Berkeley was raised to the peerage as Baron Segrave, of Berkeley Castle in the County of Gloucester. Berkeley was returned to parliament as one of two representatives for Gloucestershire in 1810 (succeeding his uncle Sir George Cranfield-Berkeley), a seat he only held until 1811. In 1836 he was appointed Lord-Lieutenant of Gloucestershire, a post he retained until his death. In 1841 he was further honoured when he was made Earl FitzHardinge. Berkeley never married. He had several mistresses, and in 1821 John Waterhouse succeeded in an action for "criminal
Baron Berkeley Berkeley" held extensive lands in-chief of the king in 1086, as recorded by Domesday Book, including Dursley and retired as a monk to St Peter's Abbey, Gloucester in about 1091. His son Roger II (d. about 1131) and grandson Roger III (d. after 1177) also held the manor of Dursley in-chief of the king. In 1152 Roger III was deprived of the farm of Berkeley during the civil war between King Stephen and the Empress Maud. He was later restored to Dursley, and founded the family of "Berkeley of Dursley", but Berkeley Castle was granted by barony to Robert FitzHarding,