On 17 August 1929, Höss married Hedwig Hensel (3 March 1908 – 1989), whom he met in the Artaman League. Between 1930 and 1943, they had five children: two sons (Klaus and Hans-Rudolf) and three daughters (Ingebrigitt, Heidetraut, and Annegret).