The team appeared again in the Kent Senior Cup Final in two successive years, but were unsuccessful on both occasions. Season 1901–02 saw them lose a replay 1–4 to Sittingbourne (played at Ramsgate), following a 2–2 draw (played at Faversham) when a last minute penalty equaliser for Sittingbourne caused the replay. Then the following season (1902–03) they were defeated by Maidstone 1–2, with the final being played again at Faversham. During the early 1900s in addition to playing in The Kent League the club competed in the Thames & Medway Combination. In the 1903–04 FA Cup the team achieved a then club best in reaching the 4th round qualifying where they were defeated at home 0–2 by old rivals Chatham Town.