In the 2004–05 season the club won the League Challenge Cup for the first time at Ton Pentre. Further history was made in the 2005–06 season when the club lifted the Welsh League First Division Championship, only losing three games. However, they have chosen to remain in the Welsh League First Division for the 2006–07 season. Normally, the top clubs from each of the two feeder leagues (the Welsh League First Division and the Cymru Alliance) are promoted subject to an application for membership of the Welsh Premier League being received and accepted and the stadium and infrastructure safety criteria of the League being met. Goytre United elected not to apply for promotion, and the First Division runners-up, Neath Athletic, failed to meet the stadium criteria and had their bid for promotion rejected. [https://web.archive.org/web/20060619211216/http://www.welsh-premier.com/info.php