He began his coaching career at Vanderbilt University, where he coached special teams, tight ends and H-backs for the Commodores from 1995–96. In 1997, he returned to the NFL as the tight ends coach for the Baltimore Ravens. Whisenhunt changed teams very often in his early years in the league, moving to the staff of the Cleveland Browns in 1999 and to the New York Jets the following season.