Because he was a tall (for that time), handsome man with a fair complexion and firm features he was very popular among ladies; when he was acting as the vice commander of Shinsen-gumi in Kyoto he sent to his colleagues in Hino a bundle of love letters he had received from many women so as to boast his popularity.
もともと色白で引き締まった顔立ちをしており（当時としては）長身であった為、京都にて新選組副長として活動していたときなどは、日野の仲間に向けて多数の女性からの恋文をまとめて送って自慢するほどであった。