From there he returned to his alma mater to take over as head coach of the Vanderbilt University football program. Brown's five-year stint with the Commodores from 1986 to 1990 produced a record of 10–45.
After leaving his previous role, he returned to his former educational institution to become head coach for Vanderbilt University football. During his five-year tenure with the Commodores from 1986 to 1990, Brown achieved a record of 10 wins and 45 losses.