His grandson Sir Edward Baynton (1593–1657) built Spye Park House after the destruction of Bromham House in 1645 during the civil war. He was married to Stuarta, the daughter of Sir Thomas Thynne, whose brother resided at Longleat. The house passed out of the Bayntun family when the heiress Ann Baynton married Edward Rolt (d. 1722), of Sacombe Park, MP for Chippenham. (b. 1689) succeeded her brother John Bayntun (1688-1716) who was the 19th in lineal descent from Sir Henry Baynton, Knight of the Household to King Henry II. On his death, the Bayntun male line died out entirely. The two siblings were children of Henry Bayntun (1664-1691) by his wife Lady Anne Wilmot, daughter of John Wilmot, Earl of Rochester, the noted Restoration poet and libertine. Ann Baynton's first husband Edward Rolt (d. 1722) was the son of Sir Thomas Rolt (1632-1710), an early nabob who made his fortune with the East India Company. Sir Thomas purchased the medieval house and estate of Sacombe Park in Hertfordshire in 1688. Ann Rolt, née Bayntun, had several children with her first husband, and at his death, she married in 1724 the 13th Lord Somerville and had further issue, two sons and one daughter. Ann's second son Edward Rolt, later Edward Bayntun-Rolt (d. 1800), inherited the property, and was made a baronet in 1762 (see Bayntun-Rolt baronets). He had six illegitimate children with his mistress, Mary Poynter, whom he later married secretly in 1751. Their fourth and youngest but only legitimate son Sir Andrew Bayntun-Rolt, 2nd Baronet (1755–1816), was born after the marriage and thus his father's only legitimate child and heir after the marriage laws reforms of 1753. He married in 1777 Lady Maria Coventry, and separated from her for an affair with his nephew in 1783; they divorced in 1787.