most of this was coming from philadelphia , as the girls had told him : loyalist families who could not afford to leave by ship , fleeing the city with what they could carry , some with wagons or handcarts , many with no more than what they could convey on their backs or in their arms .