After the war, on September 9, 1866, DuBose was ordained as a priest in the Episcopal Church by Bishop Thomas F. Davis. (He had aligned with the Protestant Episcopal Church in the Confederate States of America during the conflict, when his brother served as Attorney General of the Confederacy). The Rev. DuBose served St. John's Parish, Fairfield, which included St. Stephen's Episcopal Church and St. John's Episcopal Church in Winnsboro. While there, DuBose also taught Greek at his alma mater, Mt. Zion College.