He is more famous in history as the brother of Philip Christoph von Königsmarck, lover of the future George I's wife, and Aurora von Königsmarck, mistress of the King of Poland and Elector of Saxony, and ancestress of George Sand. They were estranged by 1670. In his will expressly forbade interference by his wife and her relations, a powerful Wiltshire family, in his children's education and upbringing. His younger surviving son Thomas Bayntun (1667-1713) was father of Rachael Bayntun, Duchess of Kingston.