In 1324, he made the statue of Monju Bosatsu (Manjusri Bodhisattva associated with wisdom, doctrine and awareness) at Hannya-ji Temple and it was brought to light that he had implemented rituals to attempt to destroy the Kamakura Shogunate, by FUJIWARA no Kishi, chugu (the second consort of an emperor) of Godaigo from 1326, so he was arrested in 1331 and was sentenced to deportation to Io-jima Island (Kagoshima Prefecture).
1324年（元亨4）には般若寺に文殊菩薩像を造り、1326年から後醍醐中宮藤原禧子の御産祈願と称して鎌倉幕府の調伏などを行っていた事が発覚し、1331年（元徳2）には逮捕され硫黄島(鹿児島県)へ流罪となる。