While Tō-ji has survived (albeit rebuilt) into modern times, Sai-ji was burnt in 990 and 1233, then abandoned and never rebuilt.
Tō-ji remains standing to this day, albeit after being restored. In contrast, Sai-ji suffered extensive damage in 990 and 1233, leading to its abandonment without reconstruction.