In 1944, Rafi moved to Mumbai. Rafi appeared in two movies. In 1945, he appeared on the screen for the song "Tera Jalwa Jis Ne Dekha" in the film "Laila Majnu". He sang a number of songs as part of the chorus, including with K. L. Saigal from the movie "Shahjahan" (1946). Rafi sang in Mehboob Khan's "Anmol Ghadi" (1946). He had a duet with Noor Jehan in the 1947 film "Jugnu", "Yahan Badla Wafa Ka". After partition, Rafi decided to stay in India. Noor Jehan migrated to Pakistan and made a pair with playback singer Ahmed Rushdi.