While Tō-ji has survived (albeit rebuilt) into modern times, Sai-ji was burnt in 990 and 1233, then abandoned and never rebuilt.
Tō-ji has continued to exist (albeit renovated) into the present era, whereas Sai-ji was severely damaged in 990 and 1233, ultimately resulting in its abandonment with no subsequent rebuilding.