Frances Villiers, Countess of Jersey his "wife", Maria Fitzherbert, with whom he had undergone a form of marriage in a clandestine Church of England ceremony that all parties to it knew was invalid under the Royal Marriages Act 1772. Having encouraged the Prince of Wales to marry his first cousin, Caroline of Brunswick in 1794, Lady Jersey nevertheless set out to make Caroline's life difficult. However, the now Princess of Wales (Caroline) had very little regard for George IV, nor he for her, and after the birth of their child, they lived apart during their twenty-five year marriage, leaving a void Frances and other mistresses,
Edward Villiers, 1st Earl of Jersey Duke of Buckingham and of Christopher Villiers, 1st Earl of Anglesey. His sister was Elizabeth Villiers, the mistress of King William III, and was later Countess of Orkney as the wife of George Hamilton, 1st Earl of Orkney. He was admitted to St John's College, Cambridge in 1671. Villiers was Knight Marshal to the royal household in succession to his father. He was Master of the Horse to Queen Mary II and was Lord Chamberlain to King William III and to Queen Anne. In 1696 he represented his country at the Congress of Ryswick. He was ambassador at The Hague