When Yoshiyori's son Koretsuna later succeeded to the family name of Anegakoji as a result of Yoshiyori maneuvering the Imperial Court, Tokimori and other members from the Ema clan and Tokimitsu KOJIMA from the Kojima family decided to follow him.
以後良頼の朝廷工作でその子自綱が姉小路の名跡を継承すると、時盛以下江馬氏と小島家の小島時光もこれに従属した。