It was originally where the palace of Yomeimon-in stood, and later served as the residence of FUJIWARA no Norimitsu, the favorite retainer of Gotoba-in before becoming the Sento Imperial Palace (Sanjo bomon-dono) of Gotoba-in.
元は陽明門院の御所があったとされ、後に後鳥羽院の寵臣藤原範光の邸宅を経て、承元3年（1209年）に後鳥羽院の仙洞御所（三条坊門殿）となった。