Huntingfield was the second son of the London merchant Sir Joshua Vanneck, 1st Baronet, and Mary Anne Daubuz.
In the context of his family background, Huntingfield was the second child born to Sir Joshua Vanneck, a successful London merchant, and his wife, Mary Anne Daubuz.