On the other hand, the Emperor tried not to rely on Kaneie by using Kanemichi's palace, Horikawa dono (residence) (it was still used after the Emperor abdicated the throne) or using the palace of Chancellor Yoritada as a temporary palace when, on two occasions, fires occurred in the palace, so the relationship between the Emperor and Kaneie was sensitive.
これに対して天皇も2度の内裏の焼失の際に故兼通邸の堀河殿（退位後も御所として使用）や関白頼忠邸を仮の御所として兼家への依存を拒むなど、両者の緊張関係が続く事になる。