title: How to download and process large S3 file?
body: <p>I have a large JSON file (i.e 100MB to 3GB) in S3. How to process this? 
  Today, I am using <code>s3client.getObjectContent()</code> to get the input stream and trying to process.</p>
  
  <p>As I stream it, I am passing the <code>inputstream</code> to Jackson jsonparser and fetching each JSON object and calling another microservice to process the JSON object retrieved from the s3 input stream. </p>
  
  <p>Problem:</p>
  
  <p>As I am processing the JSON object, S3 stream is getting closed without processing the entire payload from S3. </p>
  
  <p>I am getting warning:</p>
  
  <blockquote>
    <p>S3AbortableInputStream:Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection </p>
  </blockquote>
  
  <p>I am looking for a way to handle large S3 payload without the S3 client closing the stream before I process the entire payload. Any best practices or insights are appreciated.</p>
  
  <p><strong>Constraints:</strong> I need to process this as a stream or with a minimal memory footprint.</p>