Ma Fuxiang was the son of Ma Qianling. His elder brothers were Ma Fushou, Ma Fulu and Ma Fucai (馬福財). He was the 4th son. He was educated in the Quran and Spring and Autumn Annals. He started studying with Ma Fulu at a martial arts hall in 1889; he and Ma Fushou then studied military school three years later. In 1895 he served under Gen. Dong Fuxiang, leading loyalist Chinese Muslims to crush a revolt by rebel Muslims in the Dungan revolt (1895–1896). The rebel Muslims were slaughtered and beheaded by the thousands by Ma Fuxiang's forces and his commanding officers received the severed heads from Ma. In 1897 a military Juren degree was awarded to Ma Fuxiang after he completed his military studies, and took the military exam.