Nagayoshi's family line was a long way from the main line of the Northern House of the Fujiwara clan, and the Takakura family was ranked as a common courtier, serving as the Chamberlain of Sixth Court Rank till the time of FUJIWARA no Norikata, Nagasue's father.
長良の系統は藤原北家の主流から大きく外れ、永季の父藤原範賢までは六位蔵人を務める地下官人だった。