Bittner started taking formal drum lessons at the age of ten years. However he has stated that he "had been banging on pots, pans, and garbage cans since he was about five." A native of Schenectady, New York, he continued to take lessons and perform in his middle school and Linton high school jazz and orchestra ensembles before attending Berklee College of Music in 1988. After a year of intensive study, he left Berklee to pursue his musical career outside the educational environment. This led to playing in various metal and hard rock bands throughout the late eighties and early nineties.