Höss was born in Baden-Baden, Germany, on 25 November 1900. His parents were Franz Xaver Höss and Lina Höss. He was the oldest of three children, and was the only son. Höss's family was very Catholic.