William Berkeley, 1st Earl FitzHardinge refused to claim his right to the earldom. In 1831 William Berkeley was raised to the peerage as Baron Segrave, of Berkeley Castle in the County of Gloucester. Berkeley was returned to parliament as one of two representatives for Gloucestershire in 1810 (succeeding his uncle Sir George Cranfield-Berkeley), a seat he only held until 1811. In 1836 he was appointed Lord-Lieutenant of Gloucestershire, a post he retained until his death. In 1841 he was further honoured when he was made Earl FitzHardinge. Berkeley never married. He had several mistresses, and in 1821 John Waterhouse succeeded in an action for "criminal
Berkeley Castle from the Minstrels' gallery. His tomb is in St Mary's churchyard which stands besides the castle. Adjoining the Great Hall was the Chapel of St Mary (now the morning room) with its painted wooden vaulted ceilings and a biblical passage, written in Norman French. In the late 16th century Queen Elizabeth I visited the castle and played bowls on the bowling green. During the English Civil War, the castle still held sufficient significance for it to be captured in 1645 by Colonel Thomas Rainsborough, for the Parliamentarian side and after a siege which saw cannon being fired at point blank