However, within the Seiwa-Genji (Minamoto clan), powerful elements of the Kawachi-Genji (Minamoto clan) based in Kamakura extended their influence, amongst dependents of the Taira clan living in regional locations who also gave their allegiance, the Ise-Heishi (Taira clan) was not disposed to become part of the Minamoto clan and chose to leave Ise Province; ultimately, like the Minamoto clan, as military nobles they chose the path to serve the Imperial Court and powerful aristocratic families.
しかし、次第に清和源氏の有力な一党である河内源氏が鎌倉を中心に勢力を拡大し、在地の平氏一門をも服属させていった中で、伊勢平氏の家系は源氏の家人となることを潔しとせず伊勢国に下向し、あくまで源氏と同様、朝廷や権門貴族に仕える軍事貴族としての道を歩んだ。