Rose returned to the VFL in a coaching capacity, taking over from Phonse Kyne in 1964 as Collingwood Football Club coach. He led the side to the Grand Final in 1964, 1966 and 1970, losing each time by a handful of points. He continued to coach Collingwood until 1971 (apart from one game in 1967 when Neil Mann, who later became his successor as coach, took the reins), before coaching Footscray Football Club between 1972 and 1975. His final stint as coach of Collingwood was in 1985 and 1986, where he held the reins for a brief period before Collingwood's severe financial crisis and poor form on the field led to his resignation in favour of Leigh Matthews. He continued to remain around the club behind the scenes right up until his death.