as they got closer , the admirals fears that they might have difficulty getting past the gate guards were allayed when he realized the guards were not doing much to stop the flow of travelers entering and leaving the city .