Murphy was of Irish descent. His was the son of Berry Emmett Murphy and Josie Bell Killian. He grew up on farms near Farmersville and Greenville, Texas. When his father left the family, Audie stopped his studies at primary school in fifth grade to help support his family. 