{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/logstash/issues/3020","labels_url":"https://api.github.com/repos/elastic/logstash/issues/3020/labels{/name}","comments_url":"https://api.github.com/repos/elastic/logstash/issues/3020/comments","events_url":"https://api.github.com/repos/elastic/logstash/issues/3020/events","html_url":"https://github.com/elastic/logstash/issues/3020","id":68683269,"number":3020,"title":"Running out of files and plugin not restartig","user":{"login":"skshandilya","id":8577813,"avatar_url":"https://avatars.githubusercontent.com/u/8577813?v=3","gravatar_id":"","url":"https://api.github.com/users/skshandilya","html_url":"https://github.com/skshandilya","followers_url":"https://api.github.com/users/skshandilya/followers","following_url":"https://api.github.com/users/skshandilya/following{/other_user}","gists_url":"https://api.github.com/users/skshandilya/gists{/gist_id}","starred_url":"https://api.github.com/users/skshandilya/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/skshandilya/subscriptions","organizations_url":"https://api.github.com/users/skshandilya/orgs","repos_url":"https://api.github.com/users/skshandilya/repos","events_url":"https://api.github.com/users/skshandilya/events{/privacy}","received_events_url":"https://api.github.com/users/skshandilya/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":4,"created_at":"2015-04-15T13:29:10Z","updated_at":"2016-01-14T01:07:01Z","closed_at":"2016-01-14T01:07:00Z","body":"This is the first time we have seen an issue where logstash is running as a process but has failed to send data with the error message too many open files...\r\nHere are the failures and the version of logstash is logstash-1.4.1-1_bd507eb.noarch\r\n\r\n{:timestamp=>\"2015-04-15T03:12:09.284000+0000\", :message=>\"A plugin had an unrecoverable error. Will restart this plugin.\\n  Plugin: <LogStash::Inputs::Tcp host=>\\\"0.0.0.0\\\", add_field=>{\\\"record_type\\\"=>\\\"event_record\\\"}, tags=>[\\\"\\\"], mode=>\\\"server\\\">\\n  Error: closed stream\", :level=>:error}\r\n{:timestamp=>\"2015-04-15T03:12:10.215000+0000\", :message=>\"Failed to flush outgoing items\", :outgoing_count=>26, :exception=>#<SocketError: initialize: java.net.SocketException: Too many open files>, :backtrace=>[\"org/jruby/ext/socket/RubySocket.java:190:in `initialize'\", \"org/jruby/RubyIO.java:852:in `new'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/ftw-0.0.39/lib/ftw/connection.rb:146:in `connect'\", \"org/jruby/RubyArray.java:1613:in `each'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/ftw-0.0.39/lib/ftw/connection.rb:139:in `connect'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/ftw-0.0.39/lib/ftw/agent.rb:406:in `connect'\", \"org/jruby/RubyProc.java:271:in `call'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/ftw-0.0.39/lib/ftw/pool.rb:48:in `fetch'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/ftw-0.0.39/lib/ftw/agent.rb:403:in `connect'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/ftw-0.0.39/lib/ftw/agent.rb:319:in `execute'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/ftw-0.0.39/lib/ftw/agent.rb:217:in `post!'\", \"/opt/logstash/lib/logstash/outputs/elasticsearch_http.rb:218:in `post'\", \"/opt/logstash/lib/logstash/outputs/elasticsearch_http.rb:213:in `flush'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:219:in `buffer_flush'\", \"org/jruby/RubyHash.java:1339:in `each'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:216:in `buffer_flush'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:193:in `buffer_flush'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:112:in `buffer_initialize'\", \"org/jruby/RubyKernel.java:1521:in `loop'\", \"/opt/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:110:in `buffer_initialize'\"], :level=>:warn}\r\n\r\nOur config at the input is\r\ninput {\r\n        tcp {\r\n                host        => \"0.0.0.0\"\r\n                add_field => {record_type => \"event_record\"}\r\n                port        => \"10061\"\r\n                codec       => \"json_lines\"\r\n                tags        => [ \"\" ]\r\n        }\r\n\r\n    udp {\r\n        host        => \"0.0.0.0\"\r\n        add_field => {record_type => \"event_record\"}\r\n        port        => \"10061\"\r\n        codec       => \"json_lines\"\r\n        tags        => [ \"\" ]\r\n        buffer_size => 10240\r\n    }\r\n}\r\nThe output is to a locally running redis server."},"comment":{"url":"https://api.github.com/repos/elastic/logstash/issues/comments/171490225","html_url":"https://github.com/elastic/logstash/issues/3020#issuecomment-171490225","issue_url":"https://api.github.com/repos/elastic/logstash/issues/3020","id":171490225,"user":{"login":"suyograo","id":1595958,"avatar_url":"https://avatars.githubusercontent.com/u/1595958?v=3","gravatar_id":"","url":"https://api.github.com/users/suyograo","html_url":"https://github.com/suyograo","followers_url":"https://api.github.com/users/suyograo/followers","following_url":"https://api.github.com/users/suyograo/following{/other_user}","gists_url":"https://api.github.com/users/suyograo/gists{/gist_id}","starred_url":"https://api.github.com/users/suyograo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/suyograo/subscriptions","organizations_url":"https://api.github.com/users/suyograo/orgs","repos_url":"https://api.github.com/users/suyograo/repos","events_url":"https://api.github.com/users/suyograo/events{/privacy}","received_events_url":"https://api.github.com/users/suyograo/received_events","type":"User","site_admin":false},"created_at":"2016-01-14T01:07:00Z","updated_at":"2016-01-14T01:07:00Z","body":"Please reopen if this issue can be reproduced with latest 2.x version"}}