they passed us by , a hundred yards or so away , and we watched them between the low-hanging branches of the cherry tree , as they made their way down the hill and towards the outskirts of the city , proudly bearing the union flag .