Loxton also played Australian rules football, and in 1942, he made his debut in the Victorian Football League (VFL)—the highest tier of competition at the time—playing for St Kilda. One of his teammates was Keith Miller, a future "Invincibles" colleague. Loxton played as both a forward and a defender, and the pair sometimes played together in attack. The recruit from Prahran played in only six matches in his first year, kicking 15 goals. Debuting in round six, he started his career brightly, kicking five and four goals in his first two matches against Melbourne and Collingwood respectively, helping his team to two victories. However, the goals and victories began to dry up and Loxton managed only six goals and one win in the remaining four matches. St Kilda came second to last and did not make the finals.