I want to know the answer to the following question:
When was the program necessary to crawl and archive the web created?
All the background I'm provided with is that "In 1996 Brewster Kahle, with Bruce Gilliat, developed software to crawl and download all publicly accessible World Wide Web pages, the Gopher hierarchy, the Netnews (Usenet) bulletin board system, and downloadable software.". Is that enough to answer the question?