Tuffey missed his first Test in one and a half years when a bruised thigh forced him to withdraw from the third Test against South Africa in 2003–04, but he was back in the team that toured England in the 2004 season. Before that series, his last three Tests had yielded three wickets, and Tuffey did not improve in the next two; a total of three wickets at a bowling average of 82 saw him dropped from the Test side. He also missed much of the ODI season in England, playing in two of the seven matches New Zealand played from June to September 2004, but returned for the home ODIs against Sri Lanka in December and Australia in February. He had success against Sri Lanka, taking the wickets of Saman Jayantha and Marvan Atapattu for figures of 8–1–17–2, but the next four ODIs were cancelled out of respect for the victims of the tsunami that struck Sri Lanka, and when the Chappell–Hadlee came around Tuffey could only take one wicket in the first three matches, conceding 25 runs in two overs in the last one.