The original Congregational Church in Barryville was organized in 1799, but the first church structure was not erected until 1835. Known as the Union Church, this structure burned in 1877 and was replaced by the present day structure in 1903. The church is no longer used for religious purposes, but its owner has adaptively reused it, preserving its historical integrity. A cemetery behind the church is the resting place for several Confederate soldiers killed on July 15, 1864 when a train carrying 833 prisoners of war to the federal prison at Elmira, NY collided with a coal train at Shohola. Nineteen guards and 51 soldiers were killed in the accident; some were buried along the tracks; the others were laid to rest in the Congregational Church Cemetery.