On April 2, 1823, John M. Dickey, moderator of a church session attended by Williamson Dunn and George Logan as elders, sent a letter to Crowe inviting him to serve at the Hanover Presbyterian Church. Disheartened by the hostility of neighbors in Kentucky, Crowe accepted the position, relieved to move to a free state. Soon after arriving in Hanover, Crowe began construction of his house. It still exists and is known today as the Crowe-Garritt House. Located just north of the present-day Hanover Presbyterian Church, the Crowe-Garritt House was added to the National Register of Historical Places in 1980.