He married twice, first in 1757 to Maria Franziska Piani, who died in 1758, and again in 1762 to Maria Anna von Gobelius. Five children were born from his second marriage, of whom two survived into adulthood: Maria Theresia (1768–1812) and Karl (1771–1822).