Some of his descendants were William Ellery Channing, Richard Henry Dana, Edie Sedgwick and actress Kyra Sedgwick and Jadriene M. Ellery. Ellery Avenue in Middletown, Rhode Island is named in his honor.