no one was allowed to pass beyond banelyns walls who was not a favored merchant , tradesman , or one of the high , and so , over the years , the lower classes who lived outside the walls had built second-hand shops , teetering inns , and rickety wooden houses that had melded into a haphazard city of its own that was like a wooden maze .