Glass Houses (album) the back cover shows Joel looking through the hole that the rock made in the glass. This alludes to the adage that "people in glass houses shouldn't throw stones". In 2004, the pop-culture journalist and rock critic Chuck Klosterman praised the album in an essay on Joel titled "Every Dog Must Have His Every Day, Every Drunk Must Have His Drink" from his book "Sex, Drugs, and Cocoa Puffs" (the title of the essay refers to a line from the "Glass Houses" song "Don't Ask Me Why"). In particular, Klosterman praised some of the more obscure tracks from the album
What Do I Have to Do as the third single off the album instead, and the track was specially remixed for single release. The 1999 biographical book "Girl Next Door" identified this track as Kylie's favourite to perform live. The single artwork was photographed by Robert Erdmann. "What Do I Have To Do?" received very positive reviews from many music critics. While reviewing the album "Rhythm of Love" (1990), Chris True from Allmusic highlighted the song as an album standout. While reviewing "Ultimate Kylie", Mark Edwards from Stylus Magazine gave it a positive remark, saying along with "Shocked", "Give Me Just a Little More Time"; "were