However, the kugyo (aristocracy), who were concerned with family status that was already in place, were opposed to the aggressive promotion made by Emperor Shirakawa, and Udaijin Nakamikado, FUJIWARA no Minetada wrote in his diary, "Chuyu-ki" (dated October 23, 1099), 'Minamoto Asomi is the Emperor's best and bravest bushi.
しかし、その白河法皇の強引な引き上げに、当時既に形成されつつあった家格に拘る公卿は反発し、中御門右大臣・藤原宗忠はその日記『中右記』承徳2年10月23日条の裏書きに「義家朝臣は天下第一武勇の士なり。