Soon after, the Southern court army was forced to move out of Kyoto due to the opposition between Takauji and the Southern court; the Southern court army with Emperor Kogon, Emperor Komyo, the Retired three Emperors of Suko, the abolished Imperial Prince Naohito were taken to Yoshino, Yamato Province; the base of the southern court, and they were confined in Ano (present-day Gojo City, Nara Prefecture).
やがて、尊氏と南朝が再度対立して南朝軍が京都からの撤退を余儀なくされると、南朝軍は光厳・光明天皇・崇光の3太上天皇と廃太子直仁親王は南朝の本拠である大和国吉野に連行され、続いて賀名生（現在の奈良県五條市）に幽閉された。