The first St. Paul's Anglican Church building was located along Highway 2, east of the village. The stone church was constructed around 1827 and was then known as St. Paul's Edwardsburgh. The land surrounding the church became a designated cemetery shortly following construction. In 1872, the building was deemed unsafe and was replaced at a new location, the corner of John and New Street. The old church was demolished, and the stones were used to erect a stone cairn on the site which it once stood. The new brick church was built with a parish hall. In 1958, an addition was added to the hall. As of 2016, this church is still in use.