Robert Breckinridge was born March 8, 1800 at Cabell's Dale near Lexington, Kentucky. He was the third son born to Senator John and Mary Hopkins (Cabell) Breckinridge. Senator Breckinridge died in 1806, leaving his wife to tend the family's large plantations. Robert soon earned a reputation of misbehaving. In one instance, he and his brother John had a physical altercation because Robert put salt in a blind cousin's coffee; in another, his mother gave him a "tremendous whipping" for beating an old slave.