He married Amy Golightly in 1832 and they lived in Spartanburg. Her sister Thurza had married Benjamin Franklin White in 1825; while is clear that there was strife between the two brothers-in-law, there is no evidence for the claim, sometimes heard among Sacred Harp singers, that B.F. White helped Walker compile the "Southern Harmony," only to be cheated of authorship rights when it was finally published. In 1842 the Whites moved from Spartanburg District, SC to Harris County, Georgia, and in 1844 B. F. White, in concert with Elisha J. King published "The Sacred Harp".