In Kagoshima, his older brother began some work and readjusted the family, however he committed a crime and the family name was taken; and Ryojiro was implicated in that and sent to Okinoerabu-jima Island (according to the description from the Kagoshima Prefectural Library).
兄が鹿児島で家を再生したが、罪を犯して名跡を取り上げられたのに連座して量次郎は沖永良島へ遠島になったとされる（鹿児島立図書館の紹介文による）。