Quarry later claimed to be 'locked out' of big-opportunity fights in 1974 by King, and found himself desperately looking for quality opponents that might get him a title shot. In June, 1974, he agreed to rematch Joe Frazier. Quarry was the same size as at their first bout, but Frazier, now 212 pounds, was bigger. Quarry attempted to box Frazier this time, but due to the years of punishment, even in the recent wins against hard hitters Lyle and Shavers, he was more open to Frazier's shots and less mobile than he used to be.