In 1908, the New York State Legislature created Route 24, an unsigned legislative route that initially extended from Fonda to Speculator via Gloversville and Mayfield. From Gloversville to Mayfield, Route 24 was routed on SH 33, which broke from East State Street at modern CR 154 and followed CR 154 toward Mayfield. In the mid-1920s, all of legislative Route 24's original routing was designated as part of NY 54, a U-shaped route that began in Utica and passed through Poland, Wilmurt, Speculator, and Gloversville before ending in Fonda.