After returning to England, Hirst completed another double in 1904. Although a leg injury reduced the pace and effectiveness of his bowling for much of the season, he scored 2,501 runs at an average of 54.36, the highest aggregate and average of his career, and took 132 wickets at 21.09. He became the first Yorkshire player to achieve the double of 2,000 runs and 100 wickets, a feat previously achieved only by the Gloucestershire trio of W. G. Grace, Charlie Townsend and Gilbert Jessop. Most of his eight centuries were either against the strongest counties or in adverse circumstances for the team. In August, Hirst had a benefit match against Lancashire from which he received £3,703, worth around £ as of , a very high sum for a benefit at the time, and his popularity was reflected in the attendance over three days of 78,792 spectators.