Following Makoto Hagiwara's death in 1925 his daughter, Takano Hagiwara, and her children became the proprietors and maintainers of the garden. With the onset of World War II in America and rising anti Japanese sentiment, Takano Hagiwara and her family were evicted from the family's home and sent to an internment camp. 120,000 Japanese and Americans of Japanese descent were sent to internment camps during the war. Despite John McLaren's agreement with Hagiwara, the displacement of his family disrupted their stay at a promised century long home and the family was not allowed back or reimbursed after the war ended. In the period of their absence, the garden was renamed "The Oriental Tea Garden," and some structures expressing Japanese sentiment were demolished, including the Hagiwara home, and the original Shinto Shrine. Japanese tea servers were replaced with Chinese women in their traditional dress.