{"action":"opened","issue":{"url":"https://api.github.com/repos/fluent/fluentd/issues/1847","repository_url":"https://api.github.com/repos/fluent/fluentd","labels_url":"https://api.github.com/repos/fluent/fluentd/issues/1847/labels{/name}","comments_url":"https://api.github.com/repos/fluent/fluentd/issues/1847/comments","events_url":"https://api.github.com/repos/fluent/fluentd/issues/1847/events","html_url":"https://github.com/fluent/fluentd/issues/1847","id":294725248,"number":1847,"title":"Send exception occurred: data error","user":{"login":"felixzh2015","id":16359007,"avatar_url":"https://avatars3.githubusercontent.com/u/16359007?v=4","gravatar_id":"","url":"https://api.github.com/users/felixzh2015","html_url":"https://github.com/felixzh2015","followers_url":"https://api.github.com/users/felixzh2015/followers","following_url":"https://api.github.com/users/felixzh2015/following{/other_user}","gists_url":"https://api.github.com/users/felixzh2015/gists{/gist_id}","starred_url":"https://api.github.com/users/felixzh2015/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/felixzh2015/subscriptions","organizations_url":"https://api.github.com/users/felixzh2015/orgs","repos_url":"https://api.github.com/users/felixzh2015/repos","events_url":"https://api.github.com/users/felixzh2015/events{/privacy}","received_events_url":"https://api.github.com/users/felixzh2015/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-02-06T11:28:53Z","updated_at":"2018-02-06T11:28:53Z","closed_at":null,"author_association":"NONE","body":"Check [CONTRIBUTING guideline](https://github.com/fluent/fluentd/blob/master/CONTRIBUTING.md) first and here is the list to help us investigate the problem.\r\n\r\n- fluentd or td-agent version.\r\n   fluentd-0.14.20\r\n- Environment information, e.g. OS.\r\n   centos in docker machine\r\n- Your configuration\r\n   <source>\r\n  @type http\r\n  port 8901\r\n  bind 0.0.0.0\r\n  body_size_limit 32m\r\n  keepalive_timeout 10s\r\n  add_remote_addr  true\r\n</source>\r\n<match **>\r\n  @type kafka_buffered\r\n  brokers       192.168.1.1:9092\r\n  buffer_type   file\r\n  buffer_path  /var/log/fluent/buffer-01/*.buffer\r\n\r\n  flush_interval 1s\r\n  buffer_chunk_limit 4m\r\n  buffer_queue_limit 43200\r\n\r\n  retry_wait          1s\r\n  max_retry_wait      60s\r\n  disable_retry_limit true\r\n\r\n  # ruby-kafka producer options\r\n  max_send_retries    1\r\n  required_acks       1\r\n  compression_codec   gzip\r\n  output_data_type json\r\n  output_include_time true\r\n  num_threads   1\r\n  #kafka_agg_max_bytes 1048576\r\n</match>\r\n\r\n<system>\r\n  # loglevel: trace, debug, info, warn, error\r\n  log_level debug\r\n</system>\r\n\r\n- Your problem explanation. If you have an error logs, write it together.\r\n2018-02-06 09:44:21 +0000 [warn]: #0 Send exception occurred: data error\r\n2018-02-06 09:44:21 +0000 [warn]: #0 Exception Backtrace : /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/gzip_codec.rb:17:in close' /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/gzip_codec.rb:17:incompress'\r\n/usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/compressor.rb:50:in block in compress_data' /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/instrumenter.rb:21:ininstrument'\r\n/usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/compressor.rb:49:in compress_data' /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/compressor.rb:34:incompress'\r\n/usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/produce_operation.rb:89:in block (2 levels) in send_buffered_messages' /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/message_buffer.rb:44:inblock (2 levels) in each'\r\n/usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/message_buffer.rb:43:in each' /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/message_buffer.rb:43:inblock in each'\r\n/usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/message_buffer.rb:42:in each' /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/message_buffer.rb:42:ineach'\r\n/usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/produce_operation.rb:87:in block in send_buffered_messages' /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/produce_operation.rb:81:ineach'\r\n/usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/produce_operation.rb:81:in send_buffered_messages' /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/produce_operation.rb:47:inblock in execute'\r\n/usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/instrumenter.rb:21:in instrument' /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/produce_operation.rb:41:inexecute'\r\n/usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/producer.rb:301:in block in deliver_messages_with_retries' /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/producer.rb:293:inloop'\r\n/usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/producer.rb:293:in deliver_messages_with_retries' /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/producer.rb:243:inblock in deliver_messages'\r\n/usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/instrumenter.rb:21:in instrument' /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/ruby-kafka-0.4.0/lib/kafka/producer.rb:236:indeliver_messages'\r\n/usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/fluent-plugin-kafka-0.6.0/lib/fluent/plugin/out_kafka_buffered.rb:246:in deliver_messages' /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/fluent-plugin-kafka-0.6.0/lib/fluent/plugin/out_kafka_buffered.rb:309:inwrite'\r\n/usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/fluentd-0.14.20/lib/fluent/compat/output.rb:131:in write' /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/fluentd-0.14.20/lib/fluent/plugin/output.rb:1043:intry_flush'\r\n/usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/fluentd-0.14.20/lib/fluent/plugin/output.rb:1268:in flush_thread_run' /usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/fluentd-0.14.20/lib/fluent/plugin/output.rb:420:inblock (2 levels) in start'\r\n/usr/local/rvm/gems/ruby-2.4.0@fluentd/gems/fluentd-0.14.20/lib/fluent/plugin_helper/thread.rb:78:in `block in thread_create'\r\n2018-02-06 09:44:21 +0000 [info]: #0 initialized kafka producer: kafka\r\n2018-02-06 09:44:21 +0000 [debug]: #0 taking back chunk for errors. chunk=\"5648805a66fd415d7ee306278c3d0f39\"\r\n2018-02-06 09:44:21 +0000 [warn]: #0 failed to flush the buffer. retry_time=0 next_retry_seconds=2018-02-06 09:44:22 +0000 chunk=\"5648805a66fd415d7ee306278c3d0f39\" error_class=Zlib::DataError error=\"data error\"\r\n2018-02-06 09:44:21 +0000 [warn]: #0 suppressed same stacktrace\r\n2018-02-06 09:44:22 +0000 [warn]: #0 retry succeeded. chunk_id=\"5648805a66fd415d7ee306278c3d0f39\"\r\n"}}
{"actor":{"display_login":"felixzh2015"}}