In October 2000, he was appointed as manager of Oxford United, with Joe Kinnear as Director of Football. Kinnear left to manage Luton Town in February 2001 and Kemp was dismissed two months later following relegation and protests by the Oxford fans. In December 2001, he was appointed as Chief Scout for Leicester City. Later that month he was named as one of the best 101 players to have played for Plymouth Argyle before joining Stoke City as first-team coach in August 2004, again working under Tony Pulis. Kemp left Stoke in June 2005 when Pulis was dismissed.