Coles was born on December 15, 1786 in Albemarle County, Virginia. He studied at The College of William & Mary. Coles was married to Sally Logan Roberts from 1809 until his death in 1868. They had no children. Coles died on July 7, 1868 in Philadelphia, Pennsylvania from natural causes, aged 81.