Glass Houses (album) the back cover shows Joel looking through the hole that the rock made in the glass. This alludes to the adage that "people in glass houses shouldn't throw stones". In 2004, the pop-culture journalist and rock critic Chuck Klosterman praised the album in an essay on Joel titled "Every Dog Must Have His Every Day, Every Drunk Must Have His Drink" from his book "Sex, Drugs, and Cocoa Puffs" (the title of the essay refers to a line from the "Glass Houses" song "Don't Ask Me Why"). In particular, Klosterman praised some of the more obscure tracks from the album
What Do I Have to Do is synth orienated and has multilayered vocals. Much of the synth was omitted and the drums, bass and vocals were toned down for the second album version. The third version, the 7" Mix, contains a newer drum track, multilayered vocals in the chorus and relies much less on the synthesizers on the album version. This version of the song also contains samples from American comedian Sam Kinison, and was used for the music video. Originally, "What Do I Have To Do" was planned to be released as the follow-up single to "Better the Devil You Know", but was later released