title: Regular expressions in Sphider PHP search engine
body: <p>I try to implement a Sphider websearch in my site and start indexing. There are 2 opinions: URL must include / URL must not include. I have to use regular expressions and want to index a site that I know the link structure and I want to crawl all URLs that includes <code>http://example.com/frage/....</code></p>
  
  <p>When I put in the regex field <code>*/frage/</code> it won't work because access to index is forbidden. I also tried <code>*\/frage</code> and <code>*\/frage\/</code>. </p>
  
  <p>How can I handle that?</p>