Coveleski was born as the fourth of five ball-playing brothers in the coal-mining community of Shamokin, Pennsylvania.
Coveleski's family background is described as being from a coal-mining community in Shamokin, Pennsylvania, where all of his brothers played baseball.