The cover of the E.P. was designed by Cave using photos taken by Bleddyn Butcher. The art around the pictures of the four members of the band was in the shape of a swastika. Harvey later said, "It always amazed me that people didn't get that. It was just a belly laugh for us. Hansa Studios, where we recorded it, was right near the wall and used to be a Nazi ballroom. The ghost of the Nazi era was so powerful in Berlin in the early eighties."