Not Your Kind of People World" contains a lyrical sample from the poem "Do not go gentle into that good night" by Dylan Thomas. Both daughters of Steve Marker and Butch Vig laid down vocals on the album's title track. Finnish actress Irina Björklund performs the musical saw on "Sugar". "Beloved Freak" includes a sample of Klaus Nomi, as the group felt the artist fit Manson's lyrics about "people being an outsider, feeling like a freak, and not fitting in and trying to come to terms with that it's okay to feel like you're an outsider." KROQ-FM and MTV Buzzworthy described the sound of the
I Can't Go for That (No Can Do) on VH1's list of "The 100 Greatest Songs of the '80s." According to Daryl Hall, during the recording of "We Are the World", Michael Jackson approached him and admitted to lifting the bass line for "Billie Jean" from a Hall & Oates song, apparently referring to "I Can't Go for That (No Can Do)." Hall says that he told Jackson that he had lifted the bass line from another song himself, and that it was "something we all do." Van Halen would also do something similar by lifting the synthesizer used in "Kiss On My List" for their hit "Jump".