Lee was born at Stratford Hall in Westmoreland County, Virginia, on January 19, 1807. His parents were American Revolutionary War General and Governor of Virginia, Henry "Light Horse Harry" Lee, and his wife, Anne Carter Lee. In 1818, Lee's father died in the West Indies without ever seeing his son again. Robert was raised by his mother in Alexandria, Virginia.