 Holst was born in Kristiania to merchant Johan Martin Brodtkorb Holst and Josefa Gørvell.He was a brother of Johan Throne Holst, and thus uncle of Henning Throne-Holst and Harald Throne-Holst.He married Kirstine Eleonore Sartz Fürst in 1891.