In 1978, Willoughby formed his first band, No Fixed Address. This was Australia's first indigenous rock band. The band played its first big concert in 1979, and held several gigs over the next few years. They mostly played at concerts that promoted political and social causes. The band signed a recording contract in 1982, with Rough Diamond Records. It was the first record deal with an Aboriginal musical act in Australia. The deal produced the band's first extended play, "From My Eyes", which began with the song "We Have Survived". Its sale was launched in Sydney by the Prime Minister Bob Hawke.