During live shows, some members of the group (other than Bemis) sing backing vocals. Bemis often sings parts he wrote, but which were sung by guest vocalists on studio recordings. In recent years, Bemis has switched up the lineup of performing musicians, using some permanent members of the groups, while rotating other musicians in and out of the live lineup. Beginning on the "All My Friends Are Enemies – Rarities Tour," Bemis added drummer Reed Murray, and bassist Garron DuPree. In summer of 2014 on the Hebrews tour, Bemis recruited ex-Taking Back Sunday member Fred Mascherino, Moneen guitarist Kenny Bridges, and Moving Mountains vocalist Greg Dunn to replace Jake and Jeff Turner and Parker Case, who were at the time performing with their band XO.