Throughout the 1999 season, Tolliver remained a vocal supporter of coach Ditka despite the Saints' 3–13 record, saying "I think he's a heck of a football coach, a great motivator. We just got to start buying what he's selling." Ditka was fired by the Saints, but as training camp for the 2000 season began, Tolliver was the Saints' backup quarterback behind Jeff Blake. On August 1, the Saints traded for quarterback Aaron Brooks, which left Tolliver to compete for the third-string spot alongside Jake Delhomme. The Saints' roster was reduced to 53 players, and Tolliver was among those cut. When the Saints lost Jeff Blake for the season in mid-November due to a dislocated foot, Tolliver was re-signed by the Saints, though he did not play a game that season. In July 2001, Tolliver was signed by the Green Bay Packers. This briefly reunited him with Brett Favre, with whom he was teammates in Atlanta. However, he was cut on August 21, 2001 when Doug Pederson won the backup job, and this stint marked the end of Tolliver's professional career.