His youngest child Kinnobu SAIONJI disliked the life of court nobles in Kyoto, moved to the Higo province, where he could rely on Tadaharu NAGAOKA (1622 to 1704, an ancestor of the Hosokawa-naizen family) who was a child of Kyumu NAGAOKA, and died in Kikuchi (presently Kikuyo-cho, Kumamoto Prefecture).
なお、末子の西園寺公宣は京都の公家生活を嫌って、長岡休無の子の長岡忠春（1622-1704年、細川内膳家祖）を頼って肥後国に移り住み菊池（現熊本県菊陽町）で死去した。