While working for his wife, Betsy Wollheim, as submissions editor of DAW Books, Stampfel formed the Bottle Caps, releasing "Peter Stampfel and the Bottlecaps" (1986), "The People's Republic of Rock n' Roll" (1989), and an album of standards, "You Must Remember This" (1994). He won a Grammy Award in 1998 for writing part of the liner notes for the CD reissue of the "Anthology of American Folk Music". When asked if he had plans for his award, he was quoted in "The New York Times" as saying "I'm going to put honey on mine and lick it off."