James Sharp was born near Chambersburg, Franklin County, Pennsylvania on February 10, 1784, of Scottish descent. His colonial ancestor and grandfather was Captain James Sharp (Third Battalion, Pennsylvania Regiment), a veteran of the Forbes Campaign. Captain Sharp was present in 1758 at the capture of Fort Duquesne and served under Gen. Hugh Mercer and Col. William Clapham. His father, Matthew Sharp, was a veteran of the Revolutionary War, having served as a private in the Eighth Battalion, Cumberland County, Pennsylvania Militia. In 1780 he married Elizabeth (Lindsay) Culbertson and together they had three children: Rosana, James, and Mary.