Early in his career, while serving as a field superintendent at gas and oil companies during Indiana's gas boom, Haynes invented several devices important to the advance of the natural gas industry. When working for the Indiana Natural Gas and Oil Company, he oversaw the construction of the first long-distance natural gas pipeline in the United States, connecting Chicago with the Trenton Gas Field away. He began to formulate plans for a motorized vehicle in the early 1890s; he successfully road tested his first car, the "Pioneer", on July 4, 1894—eight years after the first automobile was patented in Germany. He formed a partnership with Elmer and Edgar Apperson in 1896 to start Haynes-Apperson for the commercial production of automobiles. He renamed it Haynes Automobile Company in 1905, following the loss of his partners.