title: No FileSystem for scheme: sftp
body: <p>I am trying to use sftp in hadoop with distcp like below </p>
  
  <p><div class="snippet" data-lang="js" data-hide="false">
  <div class="snippet-code">
  <pre class="snippet-code-html lang-html prettyprint-override"><code>hadoop distcp -D fs.sftp.credfile=/home/bigsql/cred.prop sftp://&lt;&lt;ip address&gt;&gt;:22/export/home/nz/samplefile hdfs:///user/bigsql/distcp</code></pre>
  </div>
  </div>
  </p>
  
  <p>But I am getting the below error</p>
  
  <p><div class="snippet" data-lang="js" data-hide="false">
  <div class="snippet-code">
  <pre class="snippet-code-html lang-html prettyprint-override"><code>15/11/23 13:29:06 INFO tools.DistCp: Input Options: DistCpOptions{atomicCommit=false, syncFolder=false, deleteMissing=false, ignoreFailures=false, maxMaps=20, sslConfigurationFile='null', copyStrategy='uniformsize', sourceFileListing=null, sourcePaths=[sftp://&lt;&lt;source ip&gt;&gt;:22/export/home/nz/samplefile], targetPath=hdfs:/user/bigsql/distcp, targetPathExists=true, preserveRawXattrs=false}
  15/11/23 13:29:09 INFO impl.TimelineClientImpl: Timeline service address: http://bigdata.ibm.com:8188/ws/v1/timeline/
  15/11/23 13:29:09 INFO client.RMProxy: Connecting to ResourceManager at bigdata.ibm.com/&lt;&lt;target ip&gt;&gt;:8050
  15/11/23 13:29:10 ERROR tools.DistCp: Exception encountered
  java.io.IOException: No FileSystem for scheme: sftp
          at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2584)
          at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591)
          at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
          at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)
          at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)
          at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
          at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
          at org.apache.hadoop.tools.GlobbedCopyListing.doBuildListing(GlobbedCopyListing.java:76)
          at org.apache.hadoop.tools.CopyListing.buildListing(CopyListing.java:84)
          at org.apache.hadoop.tools.DistCp.createInputFileListing(DistCp.java:353)
          at org.apache.hadoop.tools.DistCp.execute(DistCp.java:160)
          at org.apache.hadoop.tools.DistCp.run(DistCp.java:121)
          at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
          at org.apache.hadoop.tools.DistCp.main(DistCp.java:401)</code></pre>
  </div>
  </div>
  </p>
  
  <p>Can anyone suggest what can be the cause of the problem.</p>