In 1984, Woolfolk was relegated to back-up status as Joe Morris took over the starting job at tailback midway through the season. The 1984 Giants made the playoffs, but Woolfolk did not touch the ball. In March 1985, the Giants traded Woolfolk to the Oilers. In reporting on the trade, "The New York Times" said: "The mystery of Butch Woolfolk, who in his three seasons with the Giants went from star running back to benchwarmer may be solved next fall, but not with Giants." Woolfolk said at the time he was "not bitter" about the trade, and Coach Bill Parcells said: "Maybe a new place will be good for Butch. I don't think he was satisfied with what transpired last year."