In 1950-51, he hit 490 runs at an average of 37.69, including 100 not out against New South Wales at the SCG. However, he struggled the following season and was dropped, and did not play a single first-class match in 1952-53. His only other first-class centuries came in 1953–54: 102 against South Australia and 111 against Western Australia. He struggled in the following two summers and could not hold a consistent position in the team, and retired. Altogether, he made 1,716 first-class runs (mostly as an opener) in 37 matches at an average of 27.23. A regular choice for the Queensland baseball team, Harvey later turned to cricket umpiring. His initial first-class match as an umpire was in 1974-75 and he stood in two Tests from 1979 to 1980 after many players and officials left for the breakaway World Series Cricket. He stood in six One Day Internationals including one of the finals of the inaugural World Series Cup. In all, he officiated in 31 first-class and 13 List A matches.