title: BigQuery faster way to insert million of rows
body: <p>I'm using bq command line and trying to insert large amount of json files with one table per day.</p>
  
  <p>My approach:</p>
  
  <ol>
  <li>list all file to be push (date named YYYMMDDHHMM.meta1.meta2.json)</li>
  <li>concatenate in the same day file => YYYMMDD.ndjson</li>
  <li>split YYYMMDD.ndjson file (500 lines files each) YYYMMDD.ndjson_splittedij</li>
  </ol>
  
  <p>loop over YYYMMDD.ndjson_splittedij and run</p>
  
  <pre><code>bq  insert --template_suffix=20160331 --dataset_id=MYDATASET TEMPLATE YYYMMDD.ndjson_splittedij
  </code></pre>
  
  <p>This approach works. I just wonder if it is possible to improve it. </p>