Born in Ciudad Ojeda, Venezuela, Pérez was signed by the Atlanta Braves as an amateur free agent in 1986. He spent eight seasons in the Braves' minor league system, eventually progressing to their Triple-A affiliate, the Richmond Braves. In , he was named the Most Valuable Player of the Venezuelan Winter League. He posted a .265 batting average with 19 doubles and 40 runs batted in with Richmond in , earning a late season call up to Atlanta. Pérez made his major league debut with the Braves at the age of 27 on September 10, 1995. In his first game as a starting player on September 15, he hit a home run for his first major league hit. Pérez made the post-season roster, but didn't get to play as the Braves went on to win the 1995 World Series.