Bagge inherited the title when his elder brother, William, died childless. He married Millicent Case Morris in 1872, with whom he had six children, four sons and two daughters.
When Bagge's older brother, William, died without any heirs, he inherited the title. In 1872, he married Millicent Case Morris and became a father to six children—four boys and two girls.