"Get Your Gunn" is a gothic rock and hard rock song with a length of three minutes and eighteen seconds. The song's lyrics were written by the band's eponymous vocalist, while its music was written by Daisy Berkowitz and Gidget Gein; the track was produced by Manson and Trent Reznor. The aforementioned murder is reflected in its lyrics "God damn your righteous hand/ I eat innocent meat/ The housewife I will beat/ The prolife I will kill". Alec Chillingworth of "Metal Hammer" found the song's "wacky, stomping hook" reminiscent of the music of Jack Off Jill.