In March 1970, the song was released as the B-side to the Beatles' single, "Let It Be", but mistitled as "You Know My Name (Look Up My Number)" on the label of the record itself (the correct title appeared on the record sleeve, however). The original Plastic Ono Band single catalogue number is visible, though scratched out, in the runout groove of the original British pressings of the "Let It Be" single. "What's the New Mary Jane" was not officially issued by the Beatles until the release of "Anthology 3" in 1996, although the song previously appeared on several bootleg records.