McCulloch was born November 11, 1811 in Rutherford County, Tennessee. He was one of thirteen children and the fourth son of Alexander McCulloch and Frances Fisher LeNoir. His father was an officer on Brigadier general John Coffee's staff in 1813 during the Creek War. His mother was a daughter of a prominent Virginian planter. After moving several times the family settled at Dyersburg, where one of their closest neighbors was Davy Crockett. Ben assumed the duties of "man of the house" and probably ended his formal education. This was at about age 14, although his father's library of books added to his continuing education. He helped with running the farm and also joined the local militia. He learned to be a great woodsman under his mentor Davy Crockett. He also learned something else from Crockett, that a military academy education was not necessary to command men in battle.