In 1963, Northam set himself the challenge of competing in the Olympic Games. He travelled to the United States, where he arranged for naval architect Bill Luders Jr. to design and build him a yacht, which was named "Barrenjoey" after the Barrenjoey Head Lighthouse near Northam's Sydney home. With fellow "Gretel" yachtsmen Peter 'Pod' O'Donnell and James Sargeant, both more than 30 years younger than him, Northam took "Barrenjoey" to a successful run of the 1964 Australian titles, the Olympic trials and further challenge races, until the team qualified for the 1964 Summer Olympics in Tokyo, Japan, despite misgivings about Northam's age, now 59. Northam marched in the opening ceremony with his son Rod, who was a reserve member of the rowing team.