In 2004, Huff spent most of the season playing third base. On May 12, he had five RBI, including a three-run home run against Chan Ho Park, in a 9–8 loss against the Texas Rangers. He saw a streak of 398 consecutive games played snapped on August 22 when he was forced to miss a few games with a minor back injury. On August 27, he had four hits in an 8–7 loss to the Athletics. He would have four hits again on September 23 in a 7–3 loss to the Yankees.