Ardoin was born near Basile in Evangeline Parish, Louisiana a descendant of both free and captive people. Amadee spoke only French and did not speak English, as did most people in this French speaking region. Developing his musical talents in preference to undertaking farm work, he played at dances, often for Cajun audiences, with fiddle players Alphonse LaFleur and Douglas Bellard. He moved around the area frequently, settling at one point near Chataignier where he met Cajun fiddle player Dennis McGee. They established a more regular musical partnership, playing at local house parties, sometimes attended by Ardoin's young cousin, Alphonse "Bois Sec" Ardoin.