Zhang was born in 1875 in Haicheng, a county in southern Fengtian province (modern Liaoning) in northeastern China, to poor parents. He received little formal education, and the only non-military trade that he learned in his lifetime was a small amount of veterinary science. His grandfather had come to the northeast after fleeing a famine in Zhili (modern Hebei) in 1821. As a child, Zhang was known by the nickname "Pimple." He spent his early youth hunting, fishing and brawling. He hunted hares in the Manchurian countryside to help feed his family. In appearance he was thin and rather short.