Chippokes Plantation saw its first non-absentee owner in 1837. Until this point, enslaved workers and paid white overseers lived on the property, while owners lived at a distance. Albert Carroll Jones, a wealthy 22-year-old from Isle of Wight County, first lived at Chippokes in the circa 1830 River House, built as a summer residence by previous owner Charles Osborne. Jones doubled the footprint of the River House in 1847. After his first wife, Anne Baskerville Jones, died in 1850, Albert began constructing a grand Italianate manor, the Jones-Stewart Mansion. Jones lived at Chippokes during and after the Civil War with his daughter, Mary Ann Jones, and his mother, Mary Anne Carroll Jones. Just before the Civil War, when Jones' prosperity as a planter and brandy manufacturer was at its height, Chippokes was home to 47 enslaved individuals, at least one of whom stayed on after the war. Jones died in 1882, leaving the property to pass through the hands of multiple family members before arriving at auction in 1918.