Weld was the son of prosperous shipmaster and ship owner William Gordon Weld and his well-connected wife Hannah Minot.
The father of Weld, William Gordon Weld, who managed ships, came from a family with financial success. His wife, Hannah Minot, had social connections. Their son was named Weld.