At Providence, Walker's game (much as that of Michigan star Cazzie Russell) was compared to that of the premier player of the era, Cincinnati Royals superstar Oscar Robertson. Walker averaged 23 points as a junior, and led the nation with 30 points per game as a senior. His career high of 50 points came in the 1965 Madison Square Garden Holiday Basketball Festival title game, when Providence defeated Bob Cousy's Boston College team 91-86 to win the tournament. For his efforts, Walker was named MVP of the tournament. Walker was also named MVP of the 1966 Holiday Festival when Providence defeated Saint Joseph's University and Cliff Anderson in the title game. With the two awards, Walker was the first player to be named MVP in the Holiday Festival two years in a row. He was considered to be the first college players to use the between-the-legs dribble as a cross-over move.