Voigt was born in Tilsit, a town which was then part of Germany but is now called Sovetsk near Kaliningrad, Russia. In 1863, aged 14, he was sent to prison for 14 days for stealing. He was expelled from school. 