During the Latin domination after the Fourth Crusade, the complex was the see of the Venetian clergy, and the icon of the Theotokos Hodegetria was housed here. The monastery was also used as an imperial palace by the last Latin Emperor, Baldwin. After the Palaiologan restoration the monastery was used again by Orthodox monks. The most famous among them was Gennadius II Scholarius, who left the Pantokrator to become the first Patriarch of Constantinople after the Islamic conquest of the city.