His immediate younger brother, Yuzo HAYASHI, held the posts of Teishin daijin (Minister of Communication) and No-shomu daijin (Minister of Agriculture and Commerce), and his third younger brother, Takatoshi IWAMURA, served as governor of prefectures of Saga, Ehime, Ishikawa, Fukuoka and Hiroshima and was conferred the title of Baron.
次弟の林有造は逓信大臣・農商務大臣、三弟の岩村高俊は佐賀、愛媛、石川、福岡、広島各県の知事を務め男爵に叙せられる。