It fell into ruin following the Meiji Restoration, and it is said that most of the nearly 200 families and priests departed, leaving behind nothing but mud walls, Tatsuo HORI and other writers expressed sorrows in their literary works.
明治維新を機に荒廃し、200戸近い家々・禰宜の大半が離散し築地塀のみが虚しく残ったといい、堀辰雄らが哀惜の詩文を残したとされる。