Following the Battle of Shiloh, Battery E moved with the rest of Sherman's division toward Corinth, Mississippi, which was occupied on May 29, 1862. Following this, they made their way down the Memphis and Charleston Railroad, skirmishing with Confederates along the way until they reached Memphis. Here they went into camp at Fort Pickering, where they spent their time drilling with their artillery pieces and horses, seeking to improve their efficiency. During this time, the regiment received new recruits, one of whom was Private James Bolton Rice, whose letters to his wife paint a vivid picture of the battery's activities from the time he joined it to his discharge in 1865.