title: scrapy allow all domains
body: <p>I saw <a href="https://stackoverflow.com/questions/6320167/python-scrapy-allowed-domains-adding-new-domains-from-database">this</a> post to make scrapy crawl any site without allowed domains restriction.</p>
  
  <p>Is there any better way of doing it, such as using a regular expression in allowed domains variable, like-</p>
  
  <pre><code>allowed_domains = ["*"]
  </code></pre>
  
  <p>I hope there is some other way than hacking into scrapy framework to do this.</p>