The situation of Coulsdon North on the so-called "fast track" of the Quarry Line posed pathing problems, as the route had to give priority to express services heading for the South Coast. Accordingly, through services to the coast were withdrawn, and the fast platforms saw only occasional use for special trains. Furthermore, the opening of Smitham (now called Coulsdon Town) in 1904 had created 3 stations in the same area and, by the 1960s, the decline had begun to set in. Only the terminal platforms were regularly used, for stopping trains from Victoria or London Bridge. Weekend passenger services were withdrawn in 1965, the goods yard was closed in 1968, and from May 1970, passenger services only operated at peak hours on weekdays. The station finally closed in 1983 as part of the resignalling of the Brighton main line.