title: Scrapy, How to still get the content with status 302 (redirecting)
body: <p>this is my simple spider code (just started):</p>
  
  <pre><code>def start_requests(self):
      urls = [
          'http://www.liputan6.com/search?q=bubarkan+hti&amp;type=all',
      ]
      for url in urls:
          yield scrapy.Request(url=url, callback=self.parse)
  
  def parse(self, response):
      page = response.url.split("/")[-2]
      filename = 'quotes-%s.html' % page
      with open(filename, 'wb') as f:
          f.write(response.body)
      self.log('Saved file %s' % filename)
  </code></pre>
  
  <p>with browser I can access the url '<a href="http://www.liputan6.com/search?q=bubarkan+hti&amp;type=all" rel="nofollow noreferrer">http://www.liputan6.com/search?q=bubarkan+hti&amp;type=all</a>' normally. But why with this scrapy I get 302 response, and I fail to crawling the page.. </p>
  
  <p>please anyone tell me, how to fix it..</p>