He took the daughter of Motohide HATANO as his legal wife but lost her and, later, took the younger sister of Sakihisa KONOE, former chief adviser to the Emperor, as his legal wife.
正室として波多野元秀の娘を娶ったが死別し、その後、前関白近衛前久の妹の近衛氏を正室として娶る。