It is traditionally said that Gyogi, priests of great sanctity during the Nara period, built Fuseya as a missionary activity when they went on pilgrimages around the country.
奈良時代の高僧・行基が布教のため全国を巡った際に造ったと伝えられる。