title: Converting protos/json in AWS Kinesis Firehose to Parquet
body: <p>I have a long-running process which generates control signals for different entities (approx. 10k) each minute. I would like to output these control signals along with various inputs (reference points, observed values) to S3 in parquet so that we can perform some analysis on the generated control signals in an ad-hoc way. The long-running process outputs the control signals and the various inputs each minute as a proto (or JSON, proto to JSON is pretty straightforward). I am thinking of streaming the output of the long-running process into a Kinesis Firehose and using a Lambda to convert to proto/JSON to parquet. Can someone provide some pointers for lambda to convert proto/JSON to parquet files?</p>