Continuing internal Han Chinese migration during the Han dynasty eventually brought all the non-Chinese Yue coastal peoples under Chinese political control and cultural influence. As the number of Han Chinese migrants intensified following the annexation of Nanyue, the Yue people were gradually absorbed and driven out into poorer land on the hills and into the mountains. Chinese military garrisons showed little patience with the Yue tribes who refused to submit to Han Chinese imperial power and resisted the influx of Han Chinese immigrants, driving them out to the coastal extremities such as the river valleys and highland areas where they became marginal scavengers and outcasts. Han dynasty rulers saw the opportunity offered by the Chinese family agricultural settlements and used it as a tool for colonizing newly conquered regions and transforming those environments. Displaced Yue tribes often staged sneak attacks and small-scale raids or attacks to reclaim their lost territories on Chinese settlements termed "rebellions" by traditional historians but were eventually stymied by the strong action of the Han dynasty's military superiority.