In 1949–50, none of the Harveys played together at first-class level; Merv had retired, Mick had moved to Queensland looking for more opportunities, while Neil was in South Africa with the Australian team. Ray and Mick played in one match each for the season, but not against the other. In 1950-51, Ray was selected in two matches for Victoria, both when Neil and the other Test players were competing against England. Both of these were against Tasmania, so he did not meet Mick. However, there were no international fixtures coinciding with Victoria's two matches with Queensland, and Neil met Mick in both of these matches. In 1951-52, Ray was able to gain selection more regularly for Victoria. All of these came when Neil and the other Test players were playing for Australia; when they available for Victoria, Ray was not selected. Ray played in both of Victoria's matches against Queensland, for whom Mick played in the first match.