He had five children: Masamori TAKAGI (eldest son), Kiyonaga TAKAGI (second son), Masatsuna TAKAGI (third son), a daughter (Shigekata ITAKURA's officially recognized wife) and another daughter (Fusauji ISHIKAWA's officially recognized wife).
子に高木正盛（長男）、高木清長（次男）、高木正綱（三男）、娘（板倉重形正室）、娘（石川総氏正室）。