Hilton was born in San Antonio, New Mexico. His father, Augustus Halvorsen "Gus" Hilton, was an immigrant from Norway. His mother, Mary Genevieve (née Laufersweiler), was an American of German descent. Hilton had eight siblings.