He was a Test selector for the Australian team from 1970 to 1981, filling the vacancy left by the retirement of former Test captain Ryder. Loxton's tenure on the selection panel coincided with a period of great upheaval in Australian cricket, on and off the field. Up until 1965, Australia had never lost a Test series to any country other than England, and their bilateral contests were regarded as the "de facto" world championship. However, in the next five years, Australia lost away to the West Indies 2–1, and to South Africa twice, 3–1 and 4–0 respectively. The former all-rounder became a selector after the whitewash in South Africa, joining Bradman and Harvey on the panel. During the 1970–71 home series against England, which Australia lost 2–1, the trio made a raft of changes, handing debuts to nine players, the largest number in a season since 1945–46 when competition resumed after World War II. One of the new players that Harvey and Loxton recommended to Bradman was Dennis Lillee, who went on to become one of Australia's greatest fast bowlers and the world's leading wicket-taker. However, the season ended acrimoniously when captain Bill Lawry was sacked before the final Test without being informed of his fate; he learned of his omission only second hand.