June 1, 1864, Battery E marched to Guntown, Mississippi, where it took part in the disastrous Battle of Brice's Crossroads on June 10. Together with the 9th Minnesota Infantry, the battery initially formed a reserve force deployed near the crossroads itself. Attacked by Confederates under General Forrest on both flanks at once, Colonel William McMillian, commanding the infantry on that portion of the field, ordered Battery E to sweep the Guntown Road with grapeshot and canister. Despite heroic efforts by the 9th Minnesota and other Federal units the Northern army was pushed back, with Col. McMillian ordering Battery E with Battery B of the Second Illinois Light Artillery to hold off the Rebels until the infantry could escape.