title: Deduplication with StormCrawler
body: <p>I see that Document Deduplication is not supported yet in Stormcrawler. Is this something in the pipeline for future? I am asking this because I see that the Signature metadata can be added in the Status core and may be that can be used to remove the duplicates with the same signature value before indexing. Just a thought if I am thinking in the right direction?</p>
  
  <p>Thanks,</p>
  
  <p>Suman </p>