His father was a Lutheran minister, but Bjørnson rejected organized religion. He married Karoline Reimers, a famous stage actress, and their son Bjørn also had great success as a stage actor, and appeared in a few early silent films. Their daughter, Bergljot, married Henrik Ibsen's son Sigurd.