He was born Arthur Jacob Arshawsky in New York, New York. He began learning the saxophone when he was 15. By age 16 he began to tour with a band. He returned to New York City and became a session musician. During the Swing Era, his big bands were very popular with hits like "Begin the Beguine" and "Stardust".