Due to being defeated in the Seikanron (debate to conquer Korea) in October 1873, he retired from public office and with people such as Taisuke ITAGAKI published the Minsen Giin Setsuritsu Kenpakusho (a political statement for democratic representatives).
明治6年10月の征韓論争に敗れたためいったん下野して、板垣退助らと共に民撰議院設立建白書を提出した。