In addition, Kanezane went against MINAMOTO no Michichika and FUJIWARA no Norisue within the Imperial Court, and with the political change in 1196, lost his position as Kanpaku (chief advisor to the emperor).
宮廷内でも源通親、藤原範季らと対立し、建久7年（1196年）政変によって関白の地位を追われることとなる。