Apsley were relegated to Division One again at the end of the 1935–36 season. In 1938–39 they reached the first round of the FA Cup for the first time, losing 2–1 at Bromley. Following World War II the club were placed in the Western Division for the 1945–46 season and finished bottom of the table. They were subsequently placed in Division One West and the club's name was changed to Hemel Hempstead. They were Division One West runners-up in 1947–48 and again in 1950–51, after which they were promoted back to the Premier Division. However, after a single season in the Premier Division the club left to join the Delphian League.