He was child of Hidetoshi SAITO, a Samurai living in Kiyokawa Village, Shonai-han, Dewa Province (present day Shonai-machi, Higashitagawa District, Yamagata Prefecture).
出羽国庄内藩領清川村（現・山形県東田川郡庄内町）の郷士の斉藤豪寿の子。