In January 1956, Lary signed a contract to return to the Lions after completing his military service in May 1956. Upon returning to the Lions, Lary became a regular in the Pro Bowl, playing in the all-star match every year from 1956 to 1962 and again in 1964. He also received first-team All-NFL honors in five years: 1956 (Associated Press and "The Sporting News" [TSN); 1957 (TSN, United Press International Newspaper Enterprise Association [NEA); 1958 (AP, UPI, NEA); 1959 (TSN, NEA); and 1962 (AP, UPI, NEA).