title: how to inject urls found during crawl into nutch seed list
body: <p>I have integrated nutch 1.13 along with solr-6.6.0 on CentOS Linux release 7.3.1611 I had given about 10 urls in seedlist which is at /usr/local/apache-nutch-1.13/urls/seed.txt I followed the <a href="https://wiki.apache.org/nutch/NutchTutorial" rel="nofollow noreferrer">tutorial</a>
  The command I used is </p>
  
  <blockquote>
    <p>/usr/local/apache-nutch-1.13/bin/crawl -i -D solr.server.url=httpxxx:8983/solr/nutch/ /usr/local/apache-nutch-1.13/urls/ crawl  100</p>
  </blockquote>
  
  <ol>
  <li>It seems to run for one or two hour. and i get corresponding results in solr. but during crawling phase alot of urls seem to be fetched and parsed in the terminal screen. Why aren't they being added to seedlist.? </li>
  </ol>
  
  <p>2.How to know whether my crawldb is growing ? It's  been about a month and the only results i get on solr are from the seedlist and its links. </p>
  
  <p>3.I have set above command in crontab -e and plesk scheduled tasks. Now I get same links many times in in return for search query. How to avoid duplicate results in solr? </p>
  
  <p>I'm a total newbie and any additional info would be helpful.</p>