A serious issue facing most southern schools in 1956 was that of desegregation. While Middleton, like most white Louisianans, was in favor of segregation, as the university president his responsibility was to uphold the laws of the state and nation. In a letter to University of Texas Chancellor Harry Ransom, Middleton detailed his efforts to keep black and white students separate and to prevent black students from participating in athletics, in spite of accepting black students into the university. He wrote, "Our Negro students have made no attempt to attend social functions, participate in athletic contests, go in the swimming pool, etc. If they did, we would, for example, discontinue the operation of the swimming pool."