He inherited the Uji no Choja (a common clan chieftain) position from his older brother, Yorimichi, and became Kanpaku (chief advisor to the emperor) since his daughter, FUJIWARA no Kanshi became the empress to the Emperor Goreizen in 1068.
兄の頼通から氏長者を譲られ、1068年娘の藤原歓子が後冷泉天皇の皇后となったことから関白となる。