In those days, people were supposed to worship God in the Church of England. There were, however, groups of people who wanted to worship God in different ways. These people were called “non-conformists”. In 1653, a sect (religious group) of non-conformists had taken over St John’s Church in Bedford. Their vicar was John Gifford. Bunyan discussed the Bible a lot with Gifford.