 Wightman was born early in 1792 in Herkimer County, New York to parents Benjamin and Esther (nee Randall) Wightman.His father was a Baptist preacher and father to 11 children.Elias taught school in New York and then traveled to Texas in 1824.