Willis began a career as an underground singer-songwriter in the outsider music tradition, with songs featuring his bizarre, humorous and often obscene lyrics sung over the auto accompaniment feature on his Technics KN electronic keyboard.