A pre-season injury kept him out of the entire 1980–81 season, during which time he coached the reserves. In this time he converted Steve Bould from a striker into a centre-back. Smith returned from injury in 1981–82, and featured regularly early in the season, and by the time another injury forced him out of the team, Stoke were in 18th place. He joined York City, who were struggling in the Fourth Division, on a one-month loan in March 1982. He debuted in a 3–1 home defeat to Hull City on 16 March 1982, and scored once for York, in a 4–2 loss away to Wigan Athletic on 2 April. Smith made seven appearances while on loan at York, and exerted his influence on the team by organising the defence; he commented that "They had been crying out for an older head like me". He was recalled by Stoke manager Richie Barker as the defence struggled in his absence, and Smith re-established himself in the team as they avoided relegation. He was handed a free transfer to York in May 1982. He said that if he had been offered a coaching role at Stoke he would have stayed, but that Barker wanted him gone as he saw him as a threat to his position. In total, Smith made 493 appearances for Stoke, a club record for a centre-back.