title: Analyzing huge amount of JSON files on S3
body: <p>I have huge amount of json files, >100TB size in total, each json file is 10GB bzipped, and each line contain a json object, and they are stored on s3</p>
  
  <ol>
  <li><p>If I want to transform the json into csv (also stored on s3) so I can import them into redshift directly, is writing custom code using hadoop the only choice?</p></li>
  <li><p>Would it be possible to do adhoc query on the json file without transform the data into other format (since I don't want to convert them into other format first every time I need to do query as the source is growing)</p></li>
  </ol>