Gilmour sent Isamu back to the United States to attend an experimental school in 1918. She and Ailes continued to reside in Japan until 1920 when they returned to the United States, settling in San Francisco, and later moving to New York, where she successfully dissuaded Isamu from his plan to attend medical school and redirected him to the artist's vocation she had chosen for him when he was still an infant. Ailes was sent to a progressive school in Connecticut.