Ryuko was banned from visiting the Edo-jo Castle in 1709, and his request for a return to the Chisoku-in Temple of Mt. Tsukuba was turned down, and he thus returned to his hometown Yamato, where he died in despair.
宝永6年（1709年）には江戸城への登城を禁じられ、筑波山知足院への復帰願いも認められず、失意の内に大和に帰郷し没した。