He weighed in on the side of his father Tameyoshi's faction, and went down to Kanto against his elder brother Yoshitomo, and there he plotted to establish a base of the power.
父の為義と対立的な兄の義朝に対して「為義派」として関東に下り、新たな勢力基盤の形成を画る。