Holliday was born near Carlisle, Pennsylvania on April 3, 1826. His parents were David and Mary (Kennedy) Holliday. Holliday attended public school and in 1852 graduated from Allegheny College in Meadville, Pennsylvania. He intended to become a lawyer but instead became a businessman. Holliday made a considerable profit of $20,000 in a short-line railroad in Pennsylvania.