Studebaker
At first, Studebaker built horse wagons used by farmers, miners and the military.  In 1902 they started making electric vehicles and in 1904 they started making gasoline vehicles.  At first they worked with other companies to make the vehicles, but starting in 1912 they made the whole car by themselves.  For fifty years they made many cars that worked well and had interesting shapes.  But the cars cost a lot of money and after some years of troubles, the company shut down in 1966.