title: Next pages and scrapy crawler doesn't work
body: <p>I'm trying to follow the pages on <a href="http://mymobile.ge/new/v2.php?cat=69" rel="nofollow">this website</a> where the next page number generation is pretty strange. Instead of normal indexation, next pages look like this:</p>
  
  <pre><code>new/v2.php?cat=69&amp;pnum=2&amp;pnum=3
  new/v2.php?cat=69&amp;pnum=2&amp;pnum=3&amp;pnum=4
  new/v2.php?cat=69&amp;pnum=2&amp;pnum=3&amp;pnum=4&amp;pnum=5
  </code></pre>
  
  <p>and as a result my scraper gets into loop and never stops, scraping items from this kind of pages:</p>
  
  <pre><code>DEBUG: Scraped from &lt;200 http://mymobile.ge/new/v2.php?cat=69&amp;pnum=1&amp;pnum=1&amp;pnum=1&amp;pnum=2&amp;pnum=3&gt;`
  </code></pre>
  
  <p>and so on.
  While the scraped items are correct and match the target(s), crawler never stops, going for pages all over again. </p>
  
  <p>my crawler looks like this:</p>
  
  <pre><code>from scrapy.item import Item, Field
  from scrapy.contrib.spiders import CrawlSpider, Rule
  from scrapy.selector import Selector
  import re
  from scrapy.contrib.linkextractors.sgml import SgmlLinkExtractor
  from urlparse import urljoin
  
  
  from mymobile.items import MymobileItem
  
  
  class MmobySpider(CrawlSpider):
      name = "mmoby2" 
      allowed_domains = ["mymobile.ge"]
      start_urls = [
          "http://mymobile.ge/new/v2.php?cat=69&amp;pnum=1"
      ]
  
      rules = (Rule(SgmlLinkExtractor(allow=("new/v2.php\?cat=69&amp;pnum=\d*", ))
              , callback="parse_items", follow=True),)
  
      def parse_items(self, response):
          sel = Selector(response)
          titles = sel.xpath('//table[@width="1000"]//td/table[@class="probg"]')
          items = []
          for t in titles:
              url = t.xpath('tr//a/@href').extract()
              item = MymobileItem()
              item["brand"] = t.xpath('tr[2]/td/text()').re('^([\w\-]+)')
              item["model"] = t.xpath('tr[2]/td/text()').re('\s+(.*)$')
              item["price"] = t.xpath('tr[3]/td//text()').re('^([0-9\.]+)')
              item["url"] = urljoin("http://mymobile.ge/new/", url[0])
  
              items.append(item)
  
          return(items)   
  </code></pre>
  
  <p>any suggestion how can I tame it?</p>