In 1964, Loxton increased his primary vote to 45.77% and defeated Pettiona for the third time, ending with a fairly safe 57.72% after the distribution of preferences. In 1967, the retired cricketer repelled a political challenge by Jack Dyer, an iconic former footballer of the Richmond Tigers famed as one of the toughest players in history, and retained his seat at further elections in 1970, 1973 and 1976 before opting to retire at the 1979 poll. Without Loxton's personal appeal, the Liberals lost the seat to the ALP upon his departure. As he continued to play first-class cricket for three years after his election to parliament, he was a busy man, and teammates described him as a hard-working representative, recalling that he often brought his political paperwork to the ground with him, going through the material while waiting in the dressing room for his turn to bat. Although he was a low-key presence in the parliamentary chambers, Loxton served on the library committee from 1958 to 1961, and he was known for his work ethic and thorough approach, as well as his "sporting charisma".