On November 9, 1984, after a year out of the ring, Holmes made his first defense of the IBF title, stopping James "Bonecrusher" Smith on a cut in the twelfth round. In the first half of 1985, Holmes stopped David Bey in ten rounds for his 19th title defense. His next against Carl "The Truth" Williams was unexpectedly tough. The younger, quicker Williams was able to out-jab the aging champion, who was left with a badly swollen eye by the end of the bout. Holmes emerged with a close, and disputed, fifteen-round unanimous decision.