His sons were Yoshitatsu SAITO, Toshiaki (Genbanosuke) SAITO, Magoshiro (Tatsumoto, Tatsushige) SAITO, Kiheiji (Tatsuyuki, Tatsusada) SAITO and Toshiharu SAITO.
子に斎藤義龍、斎藤利尭（玄蕃助）、斎藤孫四郎（龍元、龍重）、斎藤喜平治（龍之、龍定）、斎藤利治（利治）。