Originally, prestigious Inyoka such as the Kamo clan or the Onakatomi clan served as an Onmyo no kami; the post of Onmyo no kami has been succeeded by the Abe clan and the Kamo clan for generations since the appearance of Yoshimasa, and eventually it was succeeded exclusively by the Abe clan who would call themselves the Tsuchimikado family (the Abe clan) later.
本来は陰陽頭は賀茂氏や大中臣氏などの格式の高い陰陽家が歴任していたが、吉昌以降安倍氏と賀茂氏の安賀両家によって代々世襲されることとなり、やがては土御門家(安倍氏)と称する事となる安倍氏が独占していくこととなった。