The Bloomer family, originally from Rye, New York, started farming the property on the west side of the lake prior to 1760. In 1762 they purchased the land and built, along with the Palmer family, the Peach Lake Meeting House (Quaker Meeting house) at the southeast corner of the Lake. This Peach Lake meeting house, like many others, starting at Long Island Sound and heading north, was built in the disputed area between the Connecticut and New York colonies called the Oblong.