Félix Manuel Rodríguez Capó was born in the barrio of Pedro García in Coamo, Puerto Rico to Celso Quiterio Rodríguez Rivera, a salesman and Arsenia Capó Canevaro, a housekeeper. He adopted "Bobby" as his first name and, as Rodríguez is a common Hispanic surname, he reportedly opted to use his mother's less common one, Capó, instead. He then migrated to New York City early in the 1940s. Initially, he replaced Pedro Ortiz Dávila, "Davilita", in a quartet, the Cuarteto Victoria of Rafael Hernández Marín. He then joined Xavier Cugat's orchestra.