Quest was again the starting second baseman for the 1881 White Stockings. The team won its second consecutive National League pennant with a 56-28 record. Quest compiled a .246 batting average with 26 RBIs and continued to rank as one of the best defensive players in the National League, as his .929 fielding percentage led the league's second basemen, and his Defensive WAR rating of 0.9 was ninth highest among all position players. In his autobiography, Cap Anson praised Quest's contributions to the White Stockings:"Joe was a good, reliable, steady fellow, but a weak batsman. He was a conscientious player, however, and one that could always be depended upon to play the best ball that he was capable of. His strongest point was trapping an infield fly, and in this particular line he was something of a wonder."