When Powderfinger first played the song to Benmont Tench, who would feature in a piano role throughout the album, he remarked that it reminded him of Buffalo Springfield, who was an inspiration of Tom Petty and the Heartbreakers. Fanning replied that "we were thinking more of the Heartbreakers", indicating the musical style intended in "I Don't Remember", but also paying homage to Tench, whom the band would work with extensively. Tench performed with the band on the album version of the song.