Pattammal was born in a Brahmin family in Kancheepuram of Tamil Nadu, India. She was named as Alamelu, but fondly called "Patta" as a child prodigy. Her father, Damal Krishnaswamy Dikshithar, who was deeply interested in music, inspired her to learn Carnatic music. Her mother, Kanthimathi (Rajammal), although a talented singer herself, was not permitted to sing even for friends or relatives in line with strict orthodox tradition. Despite her orthodox background, Pattammal sang and showed considerable music talent at an early age.