William Berkeley, 1st Earl FitzHardinge refused to claim his right to the earldom. In 1831 William Berkeley was raised to the peerage as Baron Segrave, of Berkeley Castle in the County of Gloucester. Berkeley was returned to parliament as one of two representatives for Gloucestershire in 1810 (succeeding his uncle Sir George Cranfield-Berkeley), a seat he only held until 1811. In 1836 he was appointed Lord-Lieutenant of Gloucestershire, a post he retained until his death. In 1841 he was further honoured when he was made Earl FitzHardinge. Berkeley never married. He had several mistresses, and in 1821 John Waterhouse succeeded in an action for "criminal
Berkeley Castle Hugh Despenser, the favourite of Edward II. Then in 1327, Edward was deposed by his wife Queen Isabella and her ally Roger Mortimer, and placed in the joint custody of Mortimer’s son-in-law, Thomas de Berkeley, and de Berkeley‘s brother-in-law, John Maltravers. They brought Edward to Berkeley Castle, and held him there for five months from April to September. During that time a band of Edward's supporters attacked, entered the castle and rescued him, only for him to be recaptured soon afterwards. It is possible that his captors then moved him around between several castles to make further rescue more difficult,