During his NFL career, Lary played in Detroit's dominant defensive backfields that also included Hall of Fame inductees Jack Christiansen, Night Train Lane, and Dick LeBeau and six-time Pro Bowl selectee Jim David, with Hall of Famer Joe Schmidt filling in the gaps at middle linebacker. Playing at the right safety position, Lary ranked second in the NFL with eight interceptions in both 1956 and 1962. During his career, he totaled 50 interceptions, which ranked fifth in NFL history at the time of his retirement (trailing only Emlen Tunnell, Night Train Lane, Jack Butler, and Bobby Dillon). His 50 interception currently ranks third in Detroit Lions history behind Dick LeBeau and Lem Barney.