His father was a forester, Arthur Wilhelm Granit, and his mother was Albertina Helena Malmberg Granit. Ragnar Granit married Baroness Marguerite Emma Bruun ("Daisy") in 1929. Their son Michael Granit (b. 1930) is an architect.