In January 1863, Nariyuki was appointed as Kokuji goyogakari (a general official of the Imperial Household in charge of State affairs) whereby there was antagonism between Nariyuki and the extremist nobles who were the Joi-ha (supporters of expulsion of foreigners) including Sanetomi SANJO and Kintomo ANEGAKOJI as well as the Choshu Clan supporting them.
文久2年（1862年）12月に国事御用掛に任ぜられ、攘夷派の過激公卿三条実美や姉小路公知ら、およびそれを支援する長州藩と対立。