After the fall of Yoshinaka and the Heike family, he came back to Kyoto and served Imperial Prince Morisada who returned from the Saikai (provinces on the western seacoast) with his wife.
義仲、平家が滅亡した後には再度都に戻り、妻とともに西海から戻った守貞親王に再び仕える。