The club was founded in 1904, and started playing in the Wiltshire Premier League at their home ground of Badgers Hill A few seasons later the club experienced success when they won the Somerset Senior League Championship in the 1906–07 season, followed by two more in 1908–09 and 1910–11 as well as winning the Wiltshire League Championship in the 1909–10 season. After the league successes the club made its debut in the FA cup in the 1911–12 season reaching the fifth qualifying round before losing 4–1 to Southport Central.