The 2004–05 season reorganisation was brought about by the introduction of a North and South regional Conference leagues below the Premier. There was also the establishment of boundaries between the Southern and Isthmian League (which hitherto had overlapped). After it was all done and dusted Ashford Town found themselves in the Ryman sponsored Isthmian League Division One. This was a further demotion down the non-league structure for the club who were now in what was referred to as 'step 4' of non-league football (i.e. four levels below the Football League).