Born in Derby, Derbyshire, Doyle started his career playing for Noel-Baker School. He made his professional debut for Derby County on 1 November 2003, aged 16, in a 3–0 defeat away to Preston North End. He made his debut for the club the next day in a 2–1 defeat away to Lincoln City. Doyle returned to Derby in May 2006, having made 12 appearances during his time at Notts County. He made his debut for the club in a 1–0 defeat away to Nottingham Forest on the opening day of the 2006–07 season. Doyle made a quick impression, prompting Bradford to consider taking up the option of extending his loan to six months or a season-long loan. Bradford manager Colin Todd was convinced that Doyle's loan would be extended, promising fans that he would stay into the new year. This was confirmed later that week, keeping Doyle at the club until 1 January 2007.