{"action":"closed","issue":{"url":"https://api.github.com/repos/uken/fluent-plugin-elasticsearch/issues/207","repository_url":"https://api.github.com/repos/uken/fluent-plugin-elasticsearch","labels_url":"https://api.github.com/repos/uken/fluent-plugin-elasticsearch/issues/207/labels{/name}","comments_url":"https://api.github.com/repos/uken/fluent-plugin-elasticsearch/issues/207/comments","events_url":"https://api.github.com/repos/uken/fluent-plugin-elasticsearch/issues/207/events","html_url":"https://github.com/uken/fluent-plugin-elasticsearch/issues/207","id":185180593,"number":207,"title":"Fluentd dummy -> AWS ES fails unless fluentd running verbose","user":{"login":"mpackard-tracelink","id":23059651,"avatar_url":"https://avatars.githubusercontent.com/u/23059651?v=3","gravatar_id":"","url":"https://api.github.com/users/mpackard-tracelink","html_url":"https://github.com/mpackard-tracelink","followers_url":"https://api.github.com/users/mpackard-tracelink/followers","following_url":"https://api.github.com/users/mpackard-tracelink/following{/other_user}","gists_url":"https://api.github.com/users/mpackard-tracelink/gists{/gist_id}","starred_url":"https://api.github.com/users/mpackard-tracelink/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mpackard-tracelink/subscriptions","organizations_url":"https://api.github.com/users/mpackard-tracelink/orgs","repos_url":"https://api.github.com/users/mpackard-tracelink/repos","events_url":"https://api.github.com/users/mpackard-tracelink/events{/privacy}","received_events_url":"https://api.github.com/users/mpackard-tracelink/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2016-10-25T17:20:26Z","updated_at":"2016-10-25T22:12:09Z","closed_at":"2016-10-25T22:12:09Z","body":"#### Problem\r\n\r\nHello,\r\n\r\nI'm running fluentd with the dummy input set to generate data and sending output to an AWS ES cluster. When running fluentd normally, no dummy output is sent to ES. Running fluentd in verbose mode does, however.\r\n\r\nfluentd: 0.14.6\r\nfluent-plugin-elasticsearch: 1.7.0\r\nruby: 2.2.2p95\r\nplatform: CentOS 7 x86_64\r\nfluentd.conf:\r\n\r\n```\r\n# Load generation input\r\n<source>\r\n  @type dummy\r\n  tag input.dummy\r\n  dummy {\"key\":\"value\"}\r\n  rate 1000\r\n  auto_increment_key dummy.counter\r\n</source>\r\n\r\n# Include Elasticsearch friendly timestamps on all messages\r\n<filter **>\r\n  @type elasticsearch_timestamp_check\r\n</filter>\r\n\r\n# Elasticsearch output\r\n<match **>\r\n  @type elasticsearch\r\n  host <AWS_ES_Endpoint>\r\n  port 80\r\n  index_name foo.index\r\n  type_name foo.type\r\n  flush_interval 60\r\n</match>\r\n```\r\nRegards,\r\nMatthew Packard\r\n...\r\n#### Steps to replicate\r\n\r\n```\r\n$ fluentd -c fluentd.conf\r\n2016-10-25 17:12:39 +0000 [info]: Connection opened to Elasticsearch cluster => {:host=>\"<AWS_ES_Endpoint>\", :port=>80, :scheme=>\"http\"}\r\n2016-10-25 17:13:11 +0000 [warn]: Could not push logs to Elasticsearch, resetting connection and trying again. read timeout reached\r\n2016-10-25 17:13:13 +0000 [info]: Connection opened to Elasticsearch cluster => {:host=>\"<AWS_ES_Endpoint>\", :port=>80, :scheme=>\"http\"}\r\n2016-10-25 17:13:45 +0000 [warn]: Could not push logs to Elasticsearch, resetting connection and trying again. read timeout reached\r\n2016-10-25 17:13:45 +0000 [info]: Connection opened to Elasticsearch cluster => {:host=>\"<AWS_ES_Endpoint>\", :port=>80, :scheme=>\"http\"}\r\n2016-10-25 17:14:17 +0000 [warn]: failed to flush the buffer. plugin_id=\"object:9880f0\" retry_time=0 next_retry=2016-10-25 17:14:18 +0000 chunk=\"53fb39a0223fa5996f535e5adb41b961\" error_class=Fluent::ElasticsearchOutput::ConnectionFailure error=\"Could not push logs to Elasticsearch after 2 retries. read timeout reached\"\r\n2016-10-25 17:14:17 +0000 [warn]: /usr/local/rvm/gems/ruby-2.2.2/gems/fluent-plugin-elasticsearch-1.7.0/lib/fluent/plugin/out_elasticsearch.rb:343:in `rescue in send'\r\n2016-10-25 17:14:17 +0000 [warn]: /usr/local/rvm/gems/ruby-2.2.2/gems/fluent-plugin-elasticsearch-1.7.0/lib/fluent/plugin/out_elasticsearch.rb:333:in `send'\r\n2016-10-25 17:14:17 +0000 [warn]: /usr/local/rvm/gems/ruby-2.2.2/gems/fluent-plugin-elasticsearch-1.7.0/lib/fluent/plugin/out_elasticsearch.rb:318:in `write'\r\n2016-10-25 17:14:17 +0000 [warn]: /usr/local/rvm/gems/ruby-2.2.2/gems/fluentd-0.14.6/lib/fluent/compat/output.rb:127:in `write'\r\n2016-10-25 17:14:17 +0000 [warn]: /usr/local/rvm/gems/ruby-2.2.2/gems/fluentd-0.14.6/lib/fluent/plugin/output.rb:828:in `try_flush'\r\n2016-10-25 17:14:17 +0000 [warn]: /usr/local/rvm/gems/ruby-2.2.2/gems/fluentd-0.14.6/lib/fluent/plugin/output.rb:1015:in `flush_thread_run'\r\n2016-10-25 17:14:17 +0000 [warn]: /usr/local/rvm/gems/ruby-2.2.2/gems/fluentd-0.14.6/lib/fluent/plugin/output.rb:380:in `block (2 levels) in start'\r\n2016-10-25 17:14:17 +0000 [warn]: /usr/local/rvm/gems/ruby-2.2.2/gems/fluentd-0.14.6/lib/fluent/plugin_helper/thread.rb:66:in `block in thread_create'\r\n\r\n<no incrementing document count in ES>\r\n\r\nvs.\r\n\r\n$ fluentd -vvv -c fluentd.conf\r\n2016-10-25 17:17:18 +0000 [debug]: plugin/buffer.rb:114:start: buffer started instance=9965440 stage_size=0 queue_size=0\r\n2016-10-25 17:17:18 +0000 [debug]: plugin/filter_elasticsearch_timestamp_check.rb:30:filter: Timestamp added: 2016-10-25T17:17:18+0000\r\n2016-10-25 17:17:18 +0000 [debug]: plugin/output.rb:954:enqueue_thread_run: enqueue_thread actually running\r\n2016-10-25 17:17:18 +0000 [debug]: plugin/buffer.rb:343:enqueue_all: enqueueing all chunks in buffer instance=9965440\r\n2016-10-25 17:17:18 +0000 [trace]: plugin/buffer.rb:168:add_metadata: adding metadata instance=9965440 metadata=#<struct Fluent::Plugin::Buffer::Metadata timekey=nil, tag=nil, variables=nil>\r\n2016-10-25 17:17:18 +0000 [trace]: plugin/buffer.rb:191:write: writing events into buffer instance=9965440 metadata_size=1\r\n2016-10-25 17:17:18 +0000 [debug]: plugin/filter_elasticsearch_timestamp_check.rb:30:filter: Timestamp added: 2016-10-25T17:17:18+0000\r\n2016-10-25 17:17:18 +0000 [trace]: plugin/buffer.rb:168:add_metadata: adding metadata instance=9965440 metadata=#<struct Fluent::Plugin::Buffer::Metadata timekey=nil, tag=nil, variables=nil>\r\n2016-10-25 17:17:18 +0000 [trace]: plugin/buffer.rb:191:write: writing events into buffer instance=9965440 metadata_size=1\r\n2016-10-25 17:17:18 +0000 [debug]: plugin/filter_elasticsearch_timestamp_check.rb:30:filter: Timestamp added: 2016-10-25T17:17:18+0000\r\n2016-10-25 17:17:18 +0000 [trace]: plugin/buffer.rb:168:add_metadata: adding metadata instance=9965440 metadata=#<struct Fluent::Plugin::Buffer::Metadata timekey=nil, tag=nil, variables=nil>\r\n2016-10-25 17:17:18 +0000 [trace]: plugin/buffer.rb:191:write: writing events into buffer instance=9965440 metadata_size=1\r\n2016-10-25 17:17:18 +0000 [debug]: plugin/filter_elasticsearch_timestamp_check.rb:30:filter: Timestamp added: 2016-10-25T17:17:18+0000\r\n2016-10-25 17:17:18 +0000 [trace]: plugin/buffer.rb:168:add_metadata: adding metadata instance=9965440 metadata=#<struct Fluent::Plugin::Buffer::Metadata timekey=nil, tag=nil, variables=nil>\r\n2016-10-25 17:17:18 +0000 [trace]: plugin/buffer.rb:191:write: writing events into buffer instance=9965440 metadata_size=1\r\n\r\n<steadily incrementing document count in ES>\r\n```"}}
{"actor":{"display_login":"pitr"}}