Despite the frequent changes in manager, Phillips continued to score regularly in his partnership with new signing Peter Crouch. He managed ten league goals in 2004–05, including two in a 3–3 draw with Fulham on 5 January. Despite Phillips's goals, the club finished at the bottom of the table and were relegated after 27 years in the top flight. On 29 June 2005, Phillips departed from Southampton after two years and 22 league goals to join Aston Villa in a £1 million deal.