title: Nutch regex-urlfilter syntax
body: <p>I am running Nutch v. 1.6 and it is crawling specific sites correctly, but I can't seem to get the syntax correct for the file <code>NUTCH_ROOT/conf/regex-urlfilter.txt</code>.</p>
  
  <p>The site I want to crawl has a URL similar to this:</p>
  
  <pre><code>http://www.example.com/foo.cfm
  </code></pre>
  
  <p>On that page there are numerous links that match the following pattern:</p>
  
  <pre><code>http://www.example.com/foo.cfm/Bar_-_Foo/Extra/EX/20817/ID=6976
  </code></pre>
  
  <p>I want to crawl links that match second example above as well. In my <code>regex-urlfilter.txt</code> I have the following:</p>
  
  <pre><code>+^http://www.example.com/foo.cfm$
  +^http://www.example.com/foo.cfm/(.+)*$
  </code></pre>
  
  <p>Nutch matches on the first one and crawls it correctly, but does not seem to pick up links using the other filter. How can I get Nutch to crawl URL's like the second one above?</p>
  
  <p>I have tried the following with no luck:</p>
  
  <pre><code>+^http://www.example.com/foo.cfm/(.+)*$
  +^http://www.example.com/foo.cfm/(.)*$
  +^http://www.example.com/foo.cfm/.+$
  +^http://www.example.com/foo.cfm/(.*)*$
  </code></pre>
  
  <p>In my <code>NUTCH_ROOT/urls/nutch</code> I have:</p>
  
  <pre><code>http://www.example.com/foo.cfm/
  </code></pre>