Harvey's performances were rewarded with selection for an Australian XI in a tour match against the England cricket team at the start of the 1954–55 season. However, the match was curtailed by rain and Harvey was not able to exhibit his talents on a sticky wicket highly difficult for batting. Listed at No. 4, Harvey came in after the dismissal of his brother and made seven in his only innings. As a result, Ray was not chosen for the Test team alongside his brother during the season.