The "shōgun" bequeathed this land to Lord Naitō ("daimyō") of Tsuruga in the Edo period who completed a garden here in 1772. After the Meiji Restoration the house and its grounds were converted into an experimental agricultural centre. It then became a botanical garden before becoming an imperial garden in 1879. The current configuration of the garden was completed in 1906. Most of the garden was destroyed by air raids in 1945, during the later stages of World War II. The garden was rebuilt after the war.