title: Change File Split size in Hadoop
body: <p>I have a bunch of small files in an HDFS directory. Although the volume of the files is relatively small, <strong>the amount of processing time per file is huge</strong>. That is, a <code>64mb</code> file, which is the default split size for <code>TextInputFormat</code>,  would take even several hours to be processed. </p>
  
  <p>What I need to do, is to <strong>reduce the split size</strong>, so that I can <strong>utilize even more nodes</strong> for a job. </p>
  
  <p>So the question is, how is it possible to split the files by let's say <code>10kb</code>? Do I need to implement my own <code>InputFormat</code> and <code>RecordReader</code> for this, or is there any parameter to set? Thanks. </p>