Brown was handed the number 20 squad number at Sunderland for the 2004–05 season, with many tipping Brown to break through into the first team that season as the club bounced back from a play-off defeat to Crystal Palace the year below. Brown was named as an unused substitute for the trip to Plymouth on 21 August and officially Brown made his debut for Sunderland on 21 September, scoring twice in the 3–3 draw with Crewe Alexandra in the League Cup. Although Sunderland lost the game on penalties, Brown impressed enough to retain his place for the trip to Leeds United four days later, with the game resulting in a 1–0 victory for Sunderland.