Patterson retired from wrestling in 1984. Although retired, Patterson continued to occasionally wrestle. On January 26, 1985, he wrestled Nikolai Volkoff in a losing effort in a house show in Cincinnati, Ohio. The following month, he teamed with Andre the Giant at a pair of house shows in Canada and defeated Ken Patera and Big John Studd. He took the spot of Mad Dog Vachon on the WWF skit show Le Brunch on WWF Superstars in Canada until late summer in 1987. Several wrestlers like the Rougeau Brothers and Dino Bravo replaced him, and Frenchie Martin hosted Le Studio as a replacement of Le Brunch. Before that he made another appearance, this time in a battle royal in Montreal on February 24, 1987. He also appeared in a battle royal at a house show in Buffalo, New York on December 27. Patterson made a handful of additional appearances in Montreal in 1987, wrestling as a heel (while remaining a face or neutral backstage official in the United States and elsewhere in Canada). His most notable appearance was a win over the up-and-coming Brutus Beefcake on August 10 His final match would come three weeks later in Montreal as he fell in defeat to Beefcake and subsequently received a haircut.