The start of 1924 in Australia was highlighted by the arrival of Swedish swimmer Arne Borg, at the time the holder of four world records, to compete against the 16-year-old Charlton in the 440yd freestyle at the New South Wales Championships. The Domain Baths were filled to capacity with between 5000 and 8000 spectators, 400m queues forming outside the venue. Borg held the lead for the first half of the race until Charlton drew level, taking the lead at the 320yd mark. Charlton eventually won by 20yds to equal Borg's world record of 5 min 11.8 s. Charlton was given a lap of honour as Borg rowed him around the pool in a small boat. They again met in the 880yd and 220yd events, with Charlton winning the former in a world record time of 10 min 51.8 s and the latter in an Australian record of 2 min 23.8 s.