Kannoosan-jo Castle stood on a mountain behind Kinrin-ji Temple, in the surrounding area of which there remain the ruins of many temple living quarters for Buddhist monks and nuns such as Gokuraku-bo, Chikuchu-bo, Hozo-bo and Toryu-bo, and the site is also a sacred place of Tendai Esoteric Buddhism, with a stone wall that still stands.
神尾山城は金輪寺の裏山にあった山城で、金輪寺の周辺には、極楽坊跡、竹中坊跡、宝蔵坊跡、東柳坊跡など、数多い寺坊跡があり、天台宗天台密教の霊地で今も石垣がそのまま残っている。