In the 2003–04 season, Miller started off in the physiotherapy room; it was not until October that he made his first Premier League start. He played in a 4–5–1 formation for the following few months, situated in a right-wing role. This led to frustration on Miller's part, and his only goals up until January came in the League Cup, against Burnley, and a double against Kidderminster Harriers in the FA Cup on 13 January. The following Saturday, Wolves beat Manchester United 1–0 with Miller scoring the winner in the 65th minute. Miller then grabbed a last minute equaliser against Liverpool the following Wednesday. Despite starting many games from then on in a striker's role, those were Miller's only Premier League goals and Wolves were relegated at the end of the season.