In 1878 Dr. DuBose married Mrs. Louise Yerger, headmistress at Fairmount College for Young Ladies in Monteagle, Tennessee at a service held in the parlor of the school. He also became chaplain to the school and priest in charge of the nearby Chapel of the Holy Comforter. Upon his retirement from the faculty of the University, Dr. DuBose lived at Fairmount College and cared for the religious needs of the school and of the townspeople, riding horseback up to Gruetli, a distance of some twenty miles twice a month to perform services for the Swiss inhabitants in the area. One Sunday he would conduct the service in German and the next Sunday he would do the same in French.