In 1960, Moore was stripped of his World Light Heavyweight title by the National Boxing Association (NBA), but continued to be recognized by most major boxing authorities including the New York State Athletic Commission and The Ring Magazine. Moore won three of his four bouts in 1960, one by decision against Buddy Turman in Dallas, his lone loss coming in a ten-round decision versus Giulio Rinaldi in Rome. In 1961, he defeated Turman again by decision in Manila, Philippines before defending his Lineal World Light Heavyweight Championship for what would be the last time, beating Rinaldi by a 15-round decision to retain the belt. In his last fight that year, he once again ventured into the heavyweights, and met Pete Rademacher, a man who had made history earlier in his career by becoming the first man ever to challenge for a world title in his first professional bout (when he lost to Patterson by a knockout in six). Moore beat Rademacher by a knockout in nine.