Many of the original settlers were Presbyterian. The Wheatfield Presbyterian Church, later known simply as the Armagh Presbyterian Church, was started in 1786. The Rev. George Hill, its first minister, was installed in 1792, and was shared with churches in Fairfield and Donegal. In 1820 the congregation built a log church and in 1835-6 replaced it with a white frame church. Another Presbyterian church was built in 1905 in Seward, about 3 miles south. The two congregations merged in 1963. The Armagh church building was destroyed in 2004 after being hit by a truck.