William Berkeley, 1st Earl FitzHardinge refused to claim his right to the earldom. In 1831 William Berkeley was raised to the peerage as Baron Segrave, of Berkeley Castle in the County of Gloucester. Berkeley was returned to parliament as one of two representatives for Gloucestershire in 1810 (succeeding his uncle Sir George Cranfield-Berkeley), a seat he only held until 1811. In 1836 he was appointed Lord-Lieutenant of Gloucestershire, a post he retained until his death. In 1841 he was further honoured when he was made Earl FitzHardinge. Berkeley never married. He had several mistresses, and in 1821 John Waterhouse succeeded in an action for "criminal
James Berkeley, 1st Baron Berkeley cousin Elizabeth, daughter of the fifth Baron Berkeley and wife of Richard de Beauchamp, 13th Earl of Warwick. He was unable initially to claim Berkeley Castle, as it was taken in possession by the Earl and Countess of Warwick. In 1421, when the Warwicks finally gave up Berkeley Castle, James was summoned to Parliament by writ as Lord Berkeley. The feud did not end there as his third wife Isabel was captured by the Countess of Warwick's son-in-law the Earl of Shrewsbury, and held imprisoned until her death in 1452. Lord Berkeley was succeeded by his son from his third