title: AWS API Gateway + Firehose package multiple records
body: <p>We have an application which accepts 10K requests/second, put them into S3 and then process them. </p>
  
  <p>Currently we're using Kafka but we would like to replace it with Firehose for different reasons (maintenance, cost, etc). I configured API Gateway with Firehose and without any coding I was able to store my requests in S3 in parquet files.</p>
  
  <p>Now comes cost estimation. From Amazon <a href="https://aws.amazon.com/getting-started/projects/build-log-analytics-solution/services-costs/" rel="nofollow noreferrer">example</a> 500 records/second will cost 216 $ / month. The record size is rounded up to 5Kb. In our case 10K requests/second will cost 20 times more.</p>
  
  <p>Our record size is 1.5k. So it makes sense to package multiple records into one. I did not find an example of how to do it easily. I don't want to implement this application by myself because there are many edge cases to be managed. And for me it seems to be pretty common case which should be already implemented.</p>
  
  <p>Is there a standard way (AWS service, github project, etc) which can be used to package records? </p>
  
  <p>Or is there a better solution to my problem?</p>