Born in Augusta, New York, Miller from Hamilton College in 1861. He studied law in the office of Chief Justice Morrison Waite, and was admitted to the bar in Peru, Indiana in 1865. Miller practiced in that city for a short time, and was also the county school examiner. For many years, he was an advisor to General Benjamin Harrison. In 1889, President Harrison made Miller Attorney General. He was Attorney General until 1893.