After it served as Cloistered Emperor Kazan's residence, the Kazanin family had owned it until the relocation of the capital to Tokyo during the Meiji Restoration.
花山法皇の後院となった後に、花山院家の所有となり、明治維新による東京奠都まで存続した。