In the late 1980s, Roach and Hunter formed a band, the Altogethers, with several other Indigenous Australians and moved to Melbourne. At the urging of Henry "Uncle Banjo" Clark, Roach wrote his first song, "Took the Children Away", which he performed on a community radio station in Melbourne and on an Indigenous current affairs program in 1988. Australian musician Paul Kelly invited Roach to open his concert early in 1989, where he performed "Took the Children Away", a song telling the story of the Stolen Generations and his own experience of being forcibly removed from his family. His performance was met with stunned silence, followed by shattering applause.