He was born in Myshall, County Carlow, Ireland, on December 12, 1849, to Robert Collier and Catherine Fenelon. He emigrated to Dayton, Ohio, United States, in 1866 when he was seventeen years old. He attended St. Mary's Seminary in Cincinnati for four years. He then worked for Sadler and Company, a publisher of schoolbooks. With $300 that he saved as a salesman, he bought the printing plates to "Father Burke's Lectures". In a single year, his sales were $90,000. In July 1873 he married Catherine Dunne.