It is said that Sanyo RAI often came to borrow reference books while he was editing "Nihon Gaishi" (historical book on Japan), but the collection, which was said to include several hundred books, was presented to the Imperial court in response to an official order and stored in the Sain (Council of the Left), but a fire broke out at the Imperial Palace and the books were burnt to cinders.
頼山陽は『日本外史』を編むに際して、しばしば参考資料を借覧したというが、数百巻にも及んだという蔵書は官命に従って献上、左院に蔵され、皇居の火災に類焼して灰燼に帰したという。