the back and forth of advanced scouting missions had led them to a sprawling , abandoned country home near the tiny town of carrollton , by the southern shore of the james river as it fed into the atlantic .