Of more concern to Lee than Early's failed attack was intelligence he received that reinforcements were heading Grant's way. Just as Hoke's division was leaving Bermuda Hundred, the 16,000 men of Maj. Gen. William F. "Baldy" Smith's XVIII Corps were withdrawn from Butler's Army of the James at Grant's request and they were moving down the James River and up the York to the Pamunkey. If Smith moved due west from White House Landing to Cold Harbor, 3 miles southeast of Bethesda Church and Grant's left flank, the extended Federal line would be too far south for the Confederate right to contain it. Lee sent his cavalry under Fitzhugh Lee to secure the crossroads at Cold Harbor.