 With Charlotte he had four sons and five daughters.Their eldest son Thomas became a noted London diarist; another son, Henry, became a churchman, eventually Chancellor of the Diocese of Chester.One of their daughters, Georgiana (d. 02 December 1861), married Lord William FitzRoy.