As Masayoshi had many children (24 children of 13 sons and 11 daughters), one day, when he was asked by the Emperor Meiji how many children he had, he couldn't remember, and answered that he would research and report it later.
正義は非常に子沢山（13男11女の24人という）で、或る日、明治天皇から何人子供がいるのかと尋ねられたが咄嗟に思い出せず、「後日調査の上、御報告申し上げます」と奏上したという。