The garden centered on the pond to the east of Kogosho is said to have been created by Soami during the Muromachi period and the 'Garden of Kirishima' (where Kirishima azaleas grow) to the north is said to have been created by Enshu KOBORI.
小御所東側の池を中心とした庭園は室町時代、相阿弥の作と伝え、その北方の「霧島の庭」（霧島つつじを植える）は小堀遠州の作と伝える。