title: Flink job hangs on submission when loading big file
body: <p>I wrote a Flink streaming job in Java that loads a csv file that contains subscriber data (4 columns) and then reads data from a socket stream while matching against the subscriber data.</p>
  
  <p>Initially I was using a small csv file (8 MB) and everything was working fine:</p>
  
  <pre><code># flink run analytics-flink.jar 19001 /root/minisubs.csv /root/output.csv
  loaded 200000 subscribers from csv file
  11/02/2015 16:36:59 Job execution switched to status RUNNING.
  11/02/2015 16:36:59 Socket Stream -&gt; Flat Map -&gt; Filter -&gt; Map -&gt; Stream Sink(1/1) switched to SCHEDULED 
  11/02/2015 16:36:59 Socket Stream -&gt; Flat Map -&gt; Filter -&gt; Map -&gt; Stream Sink(1/1) switched to DEPLOYING 
  11/02/2015 16:36:59 Socket Stream -&gt; Flat Map -&gt; Filter -&gt; Map -&gt; Stream Sink(1/1) switched to RUNNING
  </code></pre>
  
  <p>I switched the csv file to a bigger one (~45 MB) and now all I see is this:</p>
  
  <pre><code># flink run analytics-flink.jar 19001 /root/subs.csv /root/output.csv
  loaded 1173547 subscribers from csv file
  </code></pre>
  
  <p>Note that the number of subscribers above is the number of lines in the file. I tried to look for any timeouts in the Flink configuration but I couldn't find any.</p>
  
  <p>Any help is greatly appreciated!</p>
  
  <p>Edit: Csv is loaded using this method by utilizing the commons-csv 1.2 library:</p>
  
  <pre><code>private static HashMap&lt;String, String&gt; loadSubscriberGroups(
              String referenceDataFile) throws IOException {
          HashMap&lt;String,String&gt; subscriberGroups = new HashMap&lt;String, String&gt;();
  
          File csvData = new File(referenceDataFile);
          CSVParser parser = CSVParser.parse(csvData, Charset.defaultCharset(), CSVFormat.EXCEL);
          for (CSVRecord csvRecord : parser) {
              String imsi = csvRecord.get(0);
              String groupStr = csvRecord.get(3);
  
              if(groupStr == null || groupStr.isEmpty()) {
                  continue;
              }
              subscriberGroups.put(imsi, groupStr);
          }
  
          return subscriberGroups;
      }
  </code></pre>
  
  <p>and here's a sample of the file (I know there's a comma at the end, the last column is empty for now):</p>
  
  <pre><code>450000000000001,450000000001,7752,Tier-2,
  450000000000002,450000000002,1112,Tier-1,
  450000000000003,450000000003,6058,Tier-2,
  </code></pre>