Even after a number of fires, the residence was reconstructed and the Retired Emperor Gotoba was also based in this palace and administered Insei (Cloistered government.)
以後も火災のたびに再建され、後鳥羽上皇もここを御所として院政の拠点とした。