Charles Cameron was the son of Walter Cameron, a London carpenter, speculative builder and a member of the London Carpenter's Company. He claimed descent from the Camerons of Lochiel, a Scottish clan deeply involved in the Jacobite rising of 1745. Walter Cameron was certainly friendly with Dr Archibald Cameron, the last Jacobite to be executed for his role in the '45 and a relation of Lochiel. Walter visited Archibald shortly before his execution and may have assisted his wife and children, one of whom was named Charles. Cameron used the Lochiel coat of arms for his personal bookplate, although modern researchers since David Talbot Rice question or deny his claims for Lochiel lineage. Researchers also disagree on the exact year of Cameron's birth, which may be either 1743, 1745 or 1746.