At a young age his father sent him to live and study in Dublin with his eldest brother, Thomas Graves. In 1780, he entered Trinity College, Dublin, under the tutorship of the Rev. William Day. Two years later, he was elected a scholar, and was said to be 'distinguished' throughout his undergraduate course as well as an active member of the College Historical Society. He graduated B.A. (1784), M.A. (1787), B.D. (1794), and D.D. (1799). In 1786, he was a successful candidate for fellowship on his first trial, becoming one of the most popular tutors at college. The following year – the same year as his marriage – he was admitted to deacon's and priest's orders.