In 1655, RYOKEI Shosen, juji of Myoshin-ji Temple, persuaded Ingen to become juji of Fumon-ji Temple in Shimagami, Settsu Province (present Takatsuki City of Osaka Prefecture), but the bakufu (Japanese feudal government headed by a shogun) forbid him to go out of the temple and also restricted the number of attendants at the meetings in the temple to within 200, because the bakufu feared Ingen's religious influence.
明暦元年(1655年)、妙心寺元住持の龍渓性潜の懇請により、摂津国嶋上（現在の大阪府高槻市）の普門寺(高槻市)に晋山するが、隠元の影響力を恐れた幕府によって、寺外に出る事を禁じられ、また寺内の会衆も200人以内に制限された。