James Monroe (New York politician) several children. His paternal 2x-great grandfather, Patrick Andrew Monroe, emigrated to America from Scotland in the mid-17th century. In 1650, he patented a large tract of land in Washington Parish, Westmoreland County, Virginia. Among James Monroe's ancestors were French Huguenot immigrants, who came to Virginia in 1700. Monroe graduated from the United States Military Academy in 1815, and was commissioned in the Artillery Corps. Shortly after graduating, he was sent to fight in the war with Algiers, and was wounded while serving as a gunnery officer on board the USS "Guerriere". From 1817 to 1822, he served as aide-de-camp to
James Monroe Gregory for six years. In 1887 he was a candidate to replace James Campbell Matthews as Washington, DC Recorder of Deeds, although the position went to William Monroe Trotter. Gregory was again a candidate for the position to succeed Trotter in late 1889, but the position went to Blanche Bruce. Gregory was president of the American Association of Educators of Colored Youth which was he founded in 1890 and led throughout its existence. He was a delegate to the 1892 Republican National Convention, and expressed interest in the Recorder of Deeds job again, which in 1893 went to C. H. J.