Bergeron would spend the next two years splitting time between Montreal and their Triple A affiliate in Ottawa. In 2003, he would spend the entire season with the AAA Edmonton Trappers. In 2004 Bergeron started the season with the Expos, however, after only 12 games and a batting average of .214 he was again sent to AAA Edmonton. On June 7, 2004 Bergeron and Saul Rivera were traded to the Milwaukee Brewers for Jason Childers and Jason Belcher. Bergeron was assigned to the Indianapolis Indians and would spend the remainder of the season there. At the end of the 2004 season Bergeron was granted free agency and was signed by the Chicago Cubs in an attempt to make the team's roster during spring training. After the 2005 spring training Bergeron was one of the final players cut from the major league roster where he then decided to sign a minor league contract with the Baltimore Orioles, playing the 2005 season with the AA Bowie Baysox batting .296 with five home runs, 33 RBI, and 13 stolen bases in 91 games. Following that season he was again granted free agency.