However, when Shugendo declined with Haibutsu-kishaku (a movement to abolish Buddhism) in the early Meiji Period, and especially by the law banning Shugendo in 1872, three families, Gokikuma, Gokijoh and Gokido closed the business and left the village, and later, the Gokitsugu family also closed the business.
ただし、明治初めの廃仏毀釈、特に1872年の修験道禁止令により修験道が衰退すると、五鬼熊、五鬼上、五鬼童の3家は廃業し里を出、その後、五鬼継家も廃業した。