William Dunn Moseley was born on February 1, 1795 at Moseley Hall in Lenoir County, North Carolina, which is a different place than Moseley Hall on the Northeast branch of the Cape Fear created by colonial official Edward Moseley, to whom he was not related. He was the son of Matthew and Elizabeth Herring Dunn Moseley, who built this Moseley Hall. He and his father were distant descendants of William Moseley, the immigrant ancestor, who came to Virginia in 1649 and built Greenwich near Norfolk on the Elizabeth River in what was then Lower Norfolk County. The plantation house was later known as Rolleston Hall.