Despite signing a new contract with Manchester City only months earlier and leaving Fulham in 2005 to return to the north, Cole signed for south coast club Portsmouth on transfer deadline day (31 August 2006) for an undisclosed fee, reported as £500,000 with the potential to rise to £1 million depending on appearances. He scored his first league goal for his new club in the 2–0 win at home to West Ham United on 14 October. However, Cole struggled to break into Harry Redknapp's side and in March 2007, he signed on loan for Birmingham City of the Championship until the end of the season. Cole returned to Portsmouth after five appearances and one goal (against Wolverhampton Wanderers) for Birmingham. He was released on 3 August 2007.