Including the song "I Just Don't Know What to Do With Myself" (a Dusty Springfield/Burt Bacharach cover) in their repertoire was Meg's idea, and the band had begun to cover the song live. "You've Got Her in Your Pocket" was a song that had been written by Jack soon after the band's debut album was released in 1999. He had planned on eventually giving it to a local band to cover, but ultimately felt it was too personal to give away and decided to include it in the album. "Girl, You've Got No Faith in Medicine" was originally written for the band's previous album, "White Blood Cells", but Meg had disliked the song and it was removed. After debating it, the song was rerecorded and included in "Elephant", but only after a line from the song was removed after it was deemed too harsh.