"Sue Me, Sue You Blues" was issued at the end of May 1973 as the second track on "Living in the Material World", following the album's lead single, "Give Me Love (Give Me Peace on Earth)". According to authors Chip Madinger and Mark Easter, Harrison considered an alternative running order, whereby "Sue Me, Sue You Blues" was track 1 and "Give Me Love" opened side two of the album. In the UK cassette format, "Sue Me, Sue You Blues" was the opening track, followed by "The Lord Loves the One (That Loves the Lord)".