Williams served on the Board of Trustees of Wake Forest University during the period of the institution's transition from rural Wake County to Winston-Salem. In addition to the Williams's contributions to the high school, the organ in Wait Chapel on the Reynolda campus of Wake Forest University is named in honor of him and his wife Flonie Cooper Williams (1893–1975). The Williams donated the organ to Wake Forest in 1956. In addition, a three-manual Reuter organ was given and installed as a memorial to Williams in Binkley Chapel on the Olde Campus of Wake Forest. The Williamses were active in Hocutt Memorial Baptist Church. The school's colors of black and gold are the same as those of Wake Forest University, an institution with which Williams had ties. Williams was also a trustee for North Carolina Baptist Hospital.