Around the time of the War of Genpei at the end of the Heian Period, ABE no Yasuchika, the great-great-grandchild of ABE Seimei's child ABE no Yoshihira, had climbed to the Shoshiinojo (Senior Fourth Rank, Upper Grade) and his child ABE no Suehiro the Shoshiinoge (Senior Fourth Rank, Lower Grade), but their power declined for a time due to their losing political influence because power subsequently shifted to the Kamakura bakufu, with the confusion during the (Japanese) Nanbokucho period (period of North and South Courts) and with the family's infighting over which Court they were to side with.
平安末期の源平の戦いのころには安倍晴明の子安倍吉平の玄孫にあたる安倍泰親が正四位上、その子の安倍季弘が正四位下にまで昇階していたが、その後の鎌倉幕府への政権移行にともなう政治的勢力失墜や、南北朝時代(日本)の混乱や両統に呼応した家内騒動によって、その勢力は一時衰退した。