the newer portions of the town had been built outside the protection of the walls , and the followers had pitched their tents on the common land surrounding the city , on the downriver side of the town .