When the Taira clan decided to leave Kyoto while under attacks by MINAMOTO no Yoshinaka in 1183, Koremori felt uneasy to make his wife who was used to Miyako (Kyoto) to die with him in western countries from Kinki district and left his wife and child in Miyako to travel west along with his followers.
寿永2年（1183年）、源義仲の攻勢の前に平氏が都落ちを決意したとき、維盛は都に慣れ親しんでいる妻を共に西国に落ち延びさせることは忍び難いとして、妻子を都に残して一門と共に西走する。