Hunter-gatherer people before the Neolithic revolution were mostly lactose intolerant. So are modern hunter-gatherers. Many modern populations are lactose-intolerant, but European populations are tolerant. That may be because milk has long been in the European diet, and so people who can take milk products have a wider potential diet. Hence in hard times they will survive better.