In his early career, Rafi associated with many contemporary music directors, most notably Naushad Ali. In the late 1950s and 1960s, he worked with other composers of the era such as O. P. Nayyar, Shankar Jaikishan, S.D. Burman and Roshan.