title: Ruby+Anemone Web Crawler: regex to match URLs ending in a series of digits
body: <p>Suppose I was trying crawl a website a skip a page that ended like so:</p>
  
  <p><a href="http://HIDDENWEBSITE.com/anonimize/index.php?page=press_and_news&amp;subpage=20060117" rel="nofollow noreferrer">http://HIDDENWEBSITE.com/anonimize/index.php?page=press_and_news&amp;subpage=20060117</a></p>
  
  <p>I am currently using Anemone gem in Ruby to build the crawler. I am using the skip_links_like method but my pattern never seems to match. I am trying to make this as generic as possible so it isn't dependent on subpage but just <code>=2105925</code> (the digits).</p>
  
  <p>I have tried <code>/=\d+$/</code> and <code>/\?.*\d+$/</code> but it doesn't seem to be working. </p>
  
  <p>This similar to <a href="https://stackoverflow.com/questions/8341203/skipping-web-pages-with-extension-pdf-zip-from-crawling-in-anemone/8349005#8349005">Skipping web-pages with extension pdf, zip from crawling in Anemone</a> but I can't make it worth with digits instead of extensions.</p>
  
  <p>Also, testing on <a href="http://regexpal.com/" rel="nofollow noreferrer">http://regexpal.com/</a> with the pattern <code>=\d+$</code> will successfully match <code>http://misc.com/test/index.php?page=news&amp;subpage=20060118</code></p>
  
  <p>EDIT:</p>
  
  <p>Here is the entirety of my code. I wonder if anyone can see exactly what's wrong.</p>
  
  <pre><code>require 'anemone'
  ...
  Anemone.crawl(url, :depth_limit =&gt; 3, :obey_robots_txt =&gt; true) do |anemone|
    anemone.skip_links_like /\?.*\d+$/
    anemone.on_every_page do |page|
      pURL = page.url.to_s
      puts "Now checking: " + pURL
      bestGuess[pURL] = match_freq( manList, page.doc.inner_text )
      puts "Successfully checked"
    end
  end
  </code></pre>
  
  <p>My output something like this:</p>
  
  <pre><code>...
  Now checking: http://MISC.com/about_us/index.php?page=press_and_news&amp;subpage=20110711
  Successfully checked
  ...
  </code></pre>