Smith attended the University of Alabama beginning in 2006. He played for coach Nick Saban's Alabama Crimson Tide football team from 2006 to 2008. In his initial year at Alabama, he started all 13 games at left tackle, becoming only the fourth true freshman offensive lineman to start for the Crimson Tide. Smith played at least 65 snaps in 10 of 13 games and played more than 70 snaps five times, while leading the Crimson Tide with 62 pancake blocks. He also scored a touchdown off of a lateral in the 34–31 Independence Bowl loss against Oklahoma State. Smith earned Freshman All-American honors by the Football Writers Association of America.