Notari was the descendant of the oldest son of KOSE no Sakaimaro who reached Jusanmi (Junior Third Rank) and assumed Sangi (Royal Advisor) and Sadaiben (Major Controller of the Left).
従三位参議左大弁巨勢堺麻呂の嫡孫。