His legal wife was Kayohime, the daughter of Narihiro Hachisuka (adopted daughter of Shinako TAKATSUKASA), and his second wives were Yukiko, the daughter of Takemichi KOGA, and the daughter of Taneyasu HIROHASHI.
正室は蜂須賀斉裕の娘（鷹司標子の養女）・賀代姫、継室は久我建通の娘・幸子、広橋胤保の娘。