Glass Houses (album) the back cover shows Joel looking through the hole that the rock made in the glass. This alludes to the adage that "people in glass houses shouldn't throw stones". In 2004, the pop-culture journalist and rock critic Chuck Klosterman praised the album in an essay on Joel titled "Every Dog Must Have His Every Day, Every Drunk Must Have His Drink" from his book "Sex, Drugs, and Cocoa Puffs" (the title of the essay refers to a line from the "Glass Houses" song "Don't Ask Me Why"). In particular, Klosterman praised some of the more obscure tracks from the album
What Do I Have to Do great songs and suddenly Kylie was a little bit cool." Jason Shawahn from About.com said along with "Better The Devil You Know" and "Wouldn't Change a Thing"; "are nothing if not pop masterpieces." He also labelled the song as a "pop classic". NME voted the song as the thirtieth best track of 1991. "What Do I Have to Do" debuted at number twenty-seven on the Australian Singles Chart, until rising and peaking at number eleven, staying there for two consecutive weeks. The song then debuted at number ninety-nine on the Dutch Top 40, until peaking at number eighty-one for one