A gothic rock and hard rock song, the track received a mostly positive response from music critics, who described it as both nightmarish and well-produced, while Manson garnered acclaim for his vocal performance. The song features saxophone played by Sugarsmack vocalist Hope Nicholls, and an audio sample of the televised suicide of R. Budd Dwyer. According to Berkowitz, the writing of the song marked a change of direction for Manson, after which he began to write more politically-charged songs. "Get Your Gunn" was blamed by the far-right in the United States for the Columbine High School massacre, and multiple critics have deemed it one of the most controversial songs of all time. Its music video was directed by Rod Chong and released in 1994. The clip garnered acclaim from critics, and the song reached number 11 on the Canadian Hot 100, three years after its initial release.