Olcott was born in Keithsburg, Illinois. He was educated at a Keithsburg elementary school and a business school in Dixon, later becoming a clerk in Chicago. In 1891, at age 19, he moved to Salem, Oregon, and became a roommate and good friend of Oswald West. West would become a major influence in the development of Olcott's political career. 