At the turn of the eleventh century, FUJIWARA no Michinaga owned the villa, and after Michinaga died, his legitimate son FUJIWARA no Yorimichi inherited the villa and FUJIWARA no Shoshi, a daughter of Michinaga (an elder sister of Yorimichi), lived there after became a nun.
11世紀に入ると、藤原道長がこれを所有してその没後は嫡男藤原頼通が継承して、道長の娘（頼通の姉）である藤原彰子が出家後の住まいとした。