When he returned to Japan due to his illness in 1905, he brought back a vast number of Western paintings including 'Impressionists' ones to build a real modern Western Art museum in the future, as well as Japan and Oriental Arts including 'Ukiyoe' which had flowed out of Japan and his book collection; however, he took a turn for the worse and died next year before he was understood by the people.
病のため1905年に帰国した際、将来日本に本格的な西洋近代美術館を作るための「印象派」を始めとする膨大な西洋絵画、「浮世絵」などの流出した日本・東洋美術や蔵書のコレクションを持って帰ったが理解が得られないまま、翌年病状が悪化し没した。