Benjamín Cole had four children with his first wife, music teacher (and long-time organist for the Roman Catholic cathedral of Mayagüez) Angelina Simón. His sons with Simón were all professional musicians at one time or another, while his daughter was the voice-over announcer for WIPM-TV, the Public Broadcasting Service (PBS) Public television station in the city. None were involved in politics. From this marriage there are many grandchildren, several involved in music like their grandparents, most notably Henry Cole, a famous percussionist and composer.