Brown was an African-American pioneer in several different literary genres, including travel writing, fiction, and drama. In 1858 he became the first published African-American playwright, and often read from this work on the lecture circuit. Following the Civil War, in 1867 he published what is considered the first history of African Americans in the Revolutionary War. He was among the first writers inducted to the Kentucky Writers Hall of Fame, established in 2013. A public school was named for him in Lexington, Kentucky.