In 1896, Armour played center field for the Paterson Silk Weavers in the Atlantic League. He compiled a .268 batting average at Paterson with 115 runs scored, 52 stolen bases and 24 extra base hits in 126 games. He also continued to play well in the outfield, with a Paterson correspondent writing to the "Sporting Life" in late June that Armour was "head and shoulders" above anything previously seen in center field and that he was playing his position in a manner that has brought forth the greatest praise from the patrons of the game."