In 1922 Apsley left the Hertfordshire Senior County League to join Division Two of the Spartan League. They were Division Two runners-up in 1923–24, after which league reorganisation saw them placed in Division Two A. They were Division Two A runners-up in 1926–27, but were demoted to Division Two West following further league reorganisation in 1928. More reorganisation in 1930 saw the club moved into Division One for the 1930–31 season. The club were Division One runners-up in 1931–32, earning promotion to the Premier Division. Although they were relegated back to Division One at the end of their first season in the Premier Division, the club were Division One champions and League Cup winners in 1933–34, earning an immediate return to the Premier Division.