Born Jānis Konrads in Riga, Latvia, Konrads emigrated with his parents Janis and Elza, grandmother, elder sister Eve and younger sister Ilsa in August 1944, initially staying in Germany. This came after occupation of Latvia by German troops during the Second World War and then reoccupation by Soviet troops. Though living in Germany until 1949, their application to immigrate to the United States was refused on account of the large size of the family. Instead, Australia accepted them. They were first located at Greta migrants' camp near Maitland, New South Wales, and then they were relocated to a camp at Uranquinty, in mid-western New South Wales, at what had been a base for the Royal Australian Air Force. There his father Janis taught the children to swim, fearing that they could drown in the many watering holes and dams in the camp. After spending four weeks in hospital due to a case of polio, Konrads swam therapeutically to rebuild strength.