Following the 1982 season at U of L, Brown returned to his roots in the state of Tennessee helping coach the Johnny Majors-run University of Tennessee Volunteers football team. During his first stint with the Vols from 1983 to 1989, Brown helped Tennessee acquire the nickname "Wide Receiver U.," coaching numerous pass catchers to greatness. Receivers Lenny Taylor, Clyde Duncan, Tim McGee, Joey Clinkscales, Anthony Miller, Alvin Harper, Anthony Morgan, and Carl Pickens all benefited from Brown's tutelage prior to their joining the professional ranks.