Kunz was born in Allentown, Pennsylvania in 1896. His father was a master baker who also played the French horn. Young Charlie began to play in front of an audience as an amateur when he was only six years old. When he was seven, he had become good enough to play as a professional pianist.