The Seymour descendants recovered the estates, owning them into the 17th century, although the only activity on Steep Holm seems to have been the employment of gull watchers and fishermen. In 1684 the Norton Beauchamp estate (possibly in Kewstoke, Somerset, near Sand Bay, north of Weston-Super-Mare) was sold to Edward Ryder. It appears to have been auctioned by decree of the Court of Chancery 11 years later in 1695, possibly because of difficulties in maintaining sea defenses along the Somerset coast; however, this seems to have been disputed in the light of outstanding mortgages. In 1699 the estates, including Steep Holm, were sold to Philip Freke of Bristol, whose descendants held it for the next 130 years. Freke's granddaughter married into the family of John Willes, who was Chief Justice of the Court of Common Pleas and Member of Parliament. During their ownership, probably around 1776, a new cottage was built on Steep Holm for fishermen. It was built using stones from the ruined priory. In 1830 the island was sold again, according to some sources this was to a cousin of John Freke Willes named William Willes; however, other sources suggest it was to a solicitor in Weston-super-Mare named John Baker.