Growing up primarily at Langley Field, Virginia, Olds virtually made daily contact with the small group of officers who would lead the U.S. Army Air Forces in World War II (one neighbor was Major Carl Spaatz, destined to become the first Chief of Staff of the USAF), and as a result was imbued with an unusually strong dedication to the air service, and conversely, with a low tolerance for officers who did not exhibit the same. On November 10, 1925, his father appeared as a witness on behalf of Billy Mitchell during Mitchell's court-martial in Washington, D.C.. He brought three-year-old Robin with him to court, dressed in an Air Service uniform, and posed with him for newspaper photographers before testifying.