title: scrapy - data from the following pages
body: <p>I have a problem.
  How to do to download data after moving to the next pages?
  It only downloads from the first page.
  I paste, my code:</p>
  
  <pre><code>    # -*- coding: utf-8 -*-
  from scrapy import Spider
  from scrapy.http import Request
  
  
  class PronobelSpider(Spider):
      name = 'pronobel'
      allowed_domains = ['pronobel.pl']
      start_urls = ['http://pronobel.pl/praca-opieka-niemcy/']
  
      def parse(self, response):
  
          jobs = response.xpath('//*[@class="offer offer-immediate"]')
          for job in jobs:
              title = job.xpath('.//*[@class="offer-title"]/text()').extract_first()
              start_date = job.xpath('.//*[@class="offer-attr offer-departure"]/text()').extract_first()
              place = job.xpath('.//*[@class="offer-attr offer-localization"]/text()').extract_first()
              language = job.xpath('.//*[@class="offer-attr offer-salary"]/text()').extract()[1]
  
              print title
              print start_date
              print place
              print language
  
          next_page_url = response.xpath('//*[@class="page-nav nav-next"]/a/@href').extract_first()
          absolute_next_page_url = response.urljoin(next_page_url)
          yield Request(absolute_next_page_url)
  </code></pre>
  
  <p>I only get data from the first page</p>