Payne boosted his grades and gained eligibility to play during his sophomore season, averaging 17 points and 10 rebounds per game, earning all-Southeastern Conference honors along the way. Impressive as these numbers were, signs of trouble developed during the season. In a road game against the Tennessee Volunteers, Payne flipped Jim Woodall head over heels battling for a rebound. The referees whistled Payne for a flagrant foul and ejected him. In the rematch against Tennessee at Kentucky, Payne again flagrantly fouled Woodall, and was ejected from this game also. Payne was also ejected from a home game against Alabama for objecting to a referee's call. Payne's temper was exacerbated by racial slurs that he heard when playing in opposing venues.