Pitt was born at Boconnoc, Cornwall, the only son of Thomas Pitt, 1st Baron Camelford and Anne, daughter of London merchant and politician Pinckney Wilkinson.
Pitt was born in Boconnoc, Cornwall, to Thomas Pitt, 1st Baron Camelford, and Anne, whose family connections included a notable London merchant and politician, Pinckney Wilkinson.