Smith next served a stint in the United States Air Force in Germany, later working as a head coach of United States Air Force Academy's baseball and golf teams. Yet, Smith's big break would come in the United States. In 1958, North Carolina coach Frank McGuire asked Smith to join his staff as an assistant coach. Smith served under McGuire for three years until 1961, when McGuire was forced to resign by Chancellor William Aycock in the wake of a major recruiting scandal, and consequently, an NCAA mandated probation.