The island was known as "Winnipague" through the 18th century. By the turn of the century, it had been renamed for Hans Hansen Bergen, an early Norwegian or Dutch settler of New Netherland. He lived in the Bergen House, which was built sometime before 1800. One story has it that Bergen's house was hit by British bombs during the American Revolutionary War, but this is not supported by documentation. Another rumor, that the American spy Nathan Hale was executed near or on Bergen Island, is also refuted by other evidence.