Between 1797-1800, John Penn, Governor of Portland and grandson of William Penn, the founder of Pennsylvania, had the Gothic revival mansion Pennsylvania Castle built on a platform above the cove. During the early 19th-century he had a bath built below the gardens of his castle, known as John Penn's Bath. However, when it was completed, the Court Leet demanded an annual rent for its use after it was built on Common Land. Penn refused to pay, and the bath was abandoned, with the remains still in existence today. Penn's servants would have been tasked with bringing water up from the cove to the bath.