Huff attended Vernon College and the University of Miami, where he finished his career second in school batting average. He was drafted by the Devil Rays in the sixth round in 1998, and debuted with them in 2000. In 2002, he finished tenth in the American League (AL) in batting average. He set a career high in 2003 with 34 home runs and batted .311 with 107 runs batted in (RBI), while tying for the lead in errors among AL right fielders with six. Next season, he batted .297 with 24 home runs and 104 RBI. In 2005, he batted .261 with 22 home runs and 92 RBI. During the 2006 season, he was traded to the Astros.