With the arrival of Cornwallis and more reinforcements from New York, the British Army numbered 7,200 men. Cornwallis wanted to push Lafayette, whose force now numbered 3,000 men with the arrival of Virginia militia. On May 24, he set out after Lafayette, who withdrew from Richmond, and linked forces with those under the command of Baron von Steuben and Anthony Wayne. Cornwallis did not pursue Lafayette. Instead, he sent raiders into central Virginia, where they attacked depots and supply convoys, before being recalled on June 20. Cornwallis then headed for Williamsburg, and Lafayette's force of now 4,500 followed him. General Clinton, in a confusing series of orders, ordered Cornwallis first to Portsmouth and then Yorktown, where he was instructed to build fortifications for a deep water port.