Wally was born in Zelzate, East Flanders. He was married to Mariëtte Roegiers until her death in October 2012. They had a daughter, Marina Wally (born 1957), who became a singer. He retired in 2012 after poor health.