Born in Londonderry, Rockingham County, New Hampshire, Patterson was the youngest of twelve children born to Thomas and Elizabeth (Wallace) Patterson.
Patterson, who was born in Londonderry, Rockingham County, New Hampshire, was the youngest of twelve siblings raised by his parents, Thomas and Elizabeth (Wallace) Patterson.