At this time it briefly existed as a chokugan-ji (temple built by imperial order) with a complex of buildings but subsequent periods of decline and revival resulted in only the main hall, Jizo-do hall and Niomon gate remaining.
この際いったんは七堂伽藍を備え勅願寺としての体裁を整えたが、その後は興廃を繰り返し、最後は本堂、地蔵堂、仁王門を残すばかりとなった。