title: How to follow pagination with scrapy
body: <p>I have this target url:  </p>
  
  <pre><code>&lt;nav&gt;
  &lt;ul class="pagination pagination-lg"&gt;
  &lt;li class="active" itemprop="pageStart"&gt;
  &lt;a href="moto.html"&gt;1&lt;/a&gt;&lt;/li&gt;
  &lt;li itemprop="pageEnd"&gt;
  &lt;a href="moto-2.html"&gt;2&lt;/a&gt;&lt;/li&gt;
  &lt;li&gt;
  &lt;a href="moto-2.html" aria-label="Next" class="xh-highlight"&gt;
      &lt;span aria-hidden="true"&gt;»&lt;/span&gt;&lt;/a&gt;
  &lt;/li&gt;&lt;
  &lt;/ul&gt;
  &lt;/nav&gt;
  </code></pre>
  
  <p>but I cant select the next page link, I try with:</p>
  
  <pre><code>    next_page_url = response.xpath('./div/div/div[1]/nav/ul/li[3]/a').extract_first()
  </code></pre>
  
  <p>also with </p>
  
  <pre><code>response.css('[class="xh-highlight"]').extract()
  </code></pre>
  
  <p>I only get as result <code>[]</code> on the shell</p>
  
  <p>other point: I set the user agent as google chrome because I read here about other user with problems on mark accents, but don't fix my problem</p>