Coleman did not play football until his senior year at Flint Central High School. Two of Coleman's older brothers had died in their youth, one from drowning and the other from pneumonia. Coleman's mother did not want her youngest son to be injured playing football. Accordingly, Coleman played No.1 trumpet in the high school band and competed in swimming for three years. When Flint Central had a swim meet with Royal Oak High School, the Royal Oak coach "made it known Coleman would not be allowed to swim because a black swimmer had never been in their pool." Flint Central swim coach, Bob Richardson, stood behind Coleman and told the Royal Oak coach that, "if Don Coleman couldn't swim, then the rest of the Flint Central team would not swim." Coleman became the first black swimmer to enter Royal Oak's pool.