In 1778 Joseph Pocklington bought the island (then known as Vicar's Island) from Miles Ponsonby for £300. He built a house, boathouse, fort and battery, and Druid circle folly on the land. The house was one of the earliest villas to be built in the lake district, an entry in Pocklington's notebooks suggests that he saw Belle Isle in 1776, perhaps inspiring his own ambition for a house on a lake district island. Pocklington held annual regattas on the lake at which he fired off his cannon and the small fort used for mock battles. Pocklington sold the island to William Peachy in 1796, a friend of poet Robert Southey.