 Harvey spent his freshman and sophomore seasons at Georgia Military Junior College and joined East Carolina as a walk-on transfer for his junior and senior seasons.Harvey played running back for his freshman, sophomore, and junior seasons before switching to defensive end for his senior season.After recording 14.5 sacks in his senior season, he was named the AAC Defensive Player of the Year.