title: Download small sample of AWS Common Crawl to local machine via http
body: <p>I'm interested in downloading raw text of a tiny subset, 10's of megs tops, of the AWS Common Crawl, as a corpus for information retrieval tests.  </p>
  
  <p>The Common Crawl pages suggest I need an S3 account and/or Java program to access it, and then I'm looking at sifting through 100's Gb's of data when all I need is a few dozen megs.</p>
  
  <p>There's <a href="https://github.com/trivio/common_crawl_index" rel="nofollow noreferrer">some code here</a>, but it requires an S3 account and access (although I do like Python).</p>
  
  <p>Is there a way I can form an http(s) URL that will let me get a tiny cross-section of a crawl for my purposes?  I believe I looked at a page that suggested a way to structure the directory with day, hour, minute, but I cannot seem to find that page again.</p>
  
  <p>Thanks!</p>