title: Solr indexing following a Nutch crawl fails, reports "Job Failed"
body: <p>I have a site hosted on my local machine that I am attempting to crawl with Nutch and index in Solr (both also on my local machine). I installed Solr 4.6.1 and Nutch 1.7 per the instructions given on the Nutch site (<a href="http://wiki.apache.org/nutch/NutchTutorial">http://wiki.apache.org/nutch/NutchTutorial</a>), and I have Solr running in my browser without issue. </p>
  
  <p>I am running the following command:</p>
  
  <pre><code>bin/nutch crawl urls -solr http://localhost:8983/solr/ -depth 1 -topN 2
  </code></pre>
  
  <p>The crawl is working fine, but when it attemps to put the data into Solr, it fails with the following output:</p>
  
  <pre><code>Indexer: starting at 2014-02-06 16:29:28
  Indexer: deleting gone documents: false
  Indexer: URL filtering: false
  Indexer: URL normalizing: false
  Active IndexWriters :
  SOLRIndexWriter
      solr.server.url : URL of the SOLR instance (mandatory)
      solr.commit.size : buffer size when sending to SOLR (default 1000)
      solr.mapping.file : name of the mapping file for fields (default solrindex-mapping.xml)
      solr.auth : use authentication (default false)
      solr.auth.username : use authentication (default false)
      solr.auth : username for authentication
      solr.auth.password : password for authentication
  
  
  Exception in thread "main" java.io.IOException: Job failed!
      at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1357)
      at org.apache.nutch.indexer.IndexingJob.index(IndexingJob.java:123)
      at org.apache.nutch.indexer.IndexingJob.index(IndexingJob.java:81)
      at org.apache.nutch.indexer.IndexingJob.index(IndexingJob.java:65)
      at org.apache.nutch.crawl.Crawl.run(Crawl.java:155)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
      at org.apache.nutch.crawl.Crawl.main(Crawl.java:55)
  </code></pre>
  
  <p>I went to the Nutch logs directory and tailed the hadoop.log file, it shows this:</p>
  
  <pre><code>2014-02-06 16:29:28,920 INFO  solr.SolrIndexWriter - Indexing 1 documents
  2014-02-06 16:29:28,921 INFO  httpclient.HttpMethodDirector - I/O exception (org.apache.commons.httpclient.NoHttpResponseException) caught when processing request: The server localhost failed to respond
  2014-02-06 16:29:28,921 INFO  httpclient.HttpMethodDirector - Retrying request
  2014-02-06 16:29:28,924 WARN  mapred.LocalJobRunner - job_local331896790_0009
  java.io.IOException
      at org.apache.nutch.indexwriter.solr.SolrIndexWriter.makeIOException(SolrIndexWriter.java:173)
      at org.apache.nutch.indexwriter.solr.SolrIndexWriter.close(SolrIndexWriter.java:159)
      at org.apache.nutch.indexer.IndexWriters.close(IndexWriters.java:118)
      at org.apache.nutch.indexer.IndexerOutputFormat$1.close(IndexerOutputFormat.java:44)
      at org.apache.hadoop.mapred.ReduceTask$OldTrackingRecordWriter.close(ReduceTask.java:467)
      at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:535)
      at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:421)
      at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:398)
  Caused by: org.apache.solr.client.solrj.SolrServerException: java.net.SocketException: Connection reset
      at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:478)
      at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:244)
      at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:105)
      at org.apache.nutch.indexwriter.solr.SolrIndexWriter.close(SolrIndexWriter.java:155)
      ... 6 more
  Caused by: java.net.SocketException: Connection reset
      at java.net.SocketInputStream.read(SocketInputStream.java:168)
      at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
      at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
      at org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78)
      at org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106)
      at org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116)
      at org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973)
      at org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)
      at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)
      at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)
      at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
      at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
      at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
      at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:422)
  </code></pre>
  
  <p>Yet, I am still able to access Solr in my browser just fine. This is my first try at Solr/Nutch - any help from those with more knowledge would be much appreciated. Thanks. </p>