In August 2010, Lee transferred to Huddersfield Town for an undisclosed fee. He made his debut for the Terriers in a 3–1 win over Charlton Athletic at the Galpharm Stadium on 28 August 2010. He quickly established a reputation cult hero with the Huddersfield supporters. On 30 October he was sent off in a league match against Walsall at the Galpharm, where Town won 1–0. On 30 January 2011, he scored his first goal for Huddersfield in an FA Cup Fourth Round 2–1 defeat to Arsenal at the Emirates Stadium. He added to his tally with a brace against Carlisle United in the Football League Trophy, though he remained goalless throughout 28 league games. He was a late substitute in the club's play-off final defeat to Peterborough United at Old Trafford.