title: Scrapy - storing crawled pages as static files
body: <p>Apologies if this is a scrapy noob question but I have spent ages looking for the answer to this:</p>
  
  <p>I want to store the raw data from each &amp; every URL I crawl in my local filesystem as a separate file (ie response.body -> /files/page123.html) - ideally with the filename being a hash of the URL. This is so I can do further processing of the HTML (ie further parsing, indexing in Solr/ElasticSearch etc).</p>
  
  <p>I've read the docs and not sure if there's a built-in way of doing this? Since the pages are by default being downloaded by the system it doesn't seem to make sense to be writing custom pipelines etc</p>