He faced a tough political struggle from the Fujiwara family; and at the age of nineteen, he was manipulated into abandoning the throne by Fujiwara no Kaneie. Kaneie told him that Ichijo (Kaneie's maternal grandson) already held the Regalia, and that there was no purpose in Kazan continuing to rule. Under some pressure, Kazan acquiesced, and went to the Gangō-ji monastery. He was accompanied by Kaneie's second son, Michikane, who was also to enter religion. When they arrived, however, Michikane said he would like to see his parents one final time while he was still a layman. Michikane never came back.