Sumiyoshi was deeply trusted by the Emperor Meiji and given responsibility for the upbringing of the emperor's grandson (who was to become the Emperor Showa), and he was posthumously promoted to full admiral.
明治天皇からの信任が篤く、皇孫（後の昭和天皇）の養育を任じられ、死後海軍大将に昇進した。