Rahman began his early musical training under Master Dhanraj, and at age 11 began playing in the orchestra of Malayalam composer (and close friend of his father) M. K. Arjunan. He soon began working with other composers, such as M. S. Viswanathan, Ilaiyaraaja, Ramesh Naidu and Raj-Koti. He had assisted Zakir Hussain, Kunnakudi Vaidyanathan and L. Shankar on world tours. He also obtained a scholarship from London Trinity College of Music.