title: Kafka Connect Sink Lag
body: <p>I have a Kafka Connect Sink writing records from a Kafka topic to S3. It's working, but it's too slow. The Kafka topic receives ~30k msg/sec. The Connect Sink isn't able to keep up. I've tried increasing the Kafka Connector <code>tasks.max</code> from 1 to 3, that created more tasks, but that didn't seem to help improve the msg/sec speed. I've tried increasing the Kafka Connect workers CPU allotment, that didn't seem to help either.</p>
  
  <p>What else can I try? What metrics would be useful to monitor to further identify the bottleneck?</p>
  
  <p>UPDATE: the Kafka topic has 5 partitions. The Kafka cluster has 5 broker servers. Kafka Connect is running in a Kubernetes cluster and is using the latest Confluent Kafka Connect 5.4.0. The Kafka brokers are running a much older version.</p>