The son of a domainal retainer, he was born in 1843 at the Edo residence (located in Kanda, Chiyoda Ward, in Edo) of the Itakura family, who were from the Annaka Domain in Kozuke Province.
天保14年（1843年）、江戸の神田(千代田区)にあった上州安中藩板倉家江戸屋敷で、藩士の子として生まれる。