The temple prospered as the most important Rinzai temple in Kyoto, and the temple grounds grew to roughly in size, extending all the way to present-day Katabira-no-Tsuji station on the Keifuku Railway. At one time, the massive grounds were said to contain some 150 sub-temples, however, the temple was plagued with numerous fires, and all of the original buildings have been destroyed. During the Middle Ages, the temple met with fire six times: in 1358, 1367, 1373, 1380, 1447 and 1467. The temple was destroyed again during the Ōnin War and subsequently rebuilt, but in 1815 it was lost to yet another fire. The temple was severely damaged during the Kinmon Incident of 1864, and most of the buildings as they stand today are reconstructions from the latter half of the Meiji period. The garden to the west of the abbey, created by Musō Soseki, shows only traces of its original design.