title: How do I update parquet file using Spark Streaming?
body: <p>I am using spark streaming to make a real-time data pipeline. 
  I am getting real-time data from Kafka and processing this data by using Spark. </p>
  
  <p>But when I update existing parquet file on S3 with newly incoming data from S3 then its performance is not good. As I have to fetch the existing partitioned parquet file from S3 and replace the old record with new record coming from Kafka and then overwrite complete partitioned parquet file on S3. </p>
  
  <p>So it's taking much time  because this table is getting updated frequently. </p>
  
  <p>Can you suggest me a better approach to perform update operation in spark streaming? </p>
  
  <p>Thanks in advance. </p>