{"action":"created","issue":{"url":"https://api.github.com/repos/aws/amazon-ecs-agent/issues/501","repository_url":"https://api.github.com/repos/aws/amazon-ecs-agent","labels_url":"https://api.github.com/repos/aws/amazon-ecs-agent/issues/501/labels{/name}","comments_url":"https://api.github.com/repos/aws/amazon-ecs-agent/issues/501/comments","events_url":"https://api.github.com/repos/aws/amazon-ecs-agent/issues/501/events","html_url":"https://github.com/aws/amazon-ecs-agent/issues/501","id":172113432,"number":501,"title":"Agent randomly disconnected from ECS, flapping (>= v1.11)","user":{"login":"josqu4red","id":1407797,"avatar_url":"https://avatars.githubusercontent.com/u/1407797?v=3","gravatar_id":"","url":"https://api.github.com/users/josqu4red","html_url":"https://github.com/josqu4red","followers_url":"https://api.github.com/users/josqu4red/followers","following_url":"https://api.github.com/users/josqu4red/following{/other_user}","gists_url":"https://api.github.com/users/josqu4red/gists{/gist_id}","starred_url":"https://api.github.com/users/josqu4red/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/josqu4red/subscriptions","organizations_url":"https://api.github.com/users/josqu4red/orgs","repos_url":"https://api.github.com/users/josqu4red/repos","events_url":"https://api.github.com/users/josqu4red/events{/privacy}","received_events_url":"https://api.github.com/users/josqu4red/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/aws/amazon-ecs-agent/labels/more%20info%20needed","name":"more info needed","color":"fbca04"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2016-08-19T11:43:39Z","updated_at":"2016-08-22T20:22:16Z","closed_at":null,"body":"After upgrade to v1.11.0 (from docker hub) ECS cluster is unstable, with agents disconnecting and reconnecting after a while, while still running, similar to #316.\r\nRunning tasks are fine but agent connection flapping prevents scheduling of new tasks.\r\nCluster is not under big load, with only 2 single-container tasks running besides ecs-agent.\r\n\r\nSame behaviour happens with v1.12.0.\r\nHosts have been upgraded to Docker 1.11.2 at the same time, but work fine with agent v1.10.\r\n\r\nHere is the agent log file, with a stacktrace while disconnected: https://gist.github.com/josqu4red/fc1bc11b2822b5050b7d4850c5e18f71\r\n\r\nAnd agent config:\r\n```\r\nECS_LOGFILE = \"/log/ecs-agent.log\" \r\nECS_DATADIR =\"/data\"\r\nECS_LOGLEVEl = \"debug\"\r\nECS_AVAILABLE_LOGGING_DRIVERS = [\"json-file\",\"fluentd\"]\r\nECS_ENGINE_TASK_CLEANUP_WAIT_DURATION = \"10m\"\r\n```"},"comment":{"url":"https://api.github.com/repos/aws/amazon-ecs-agent/issues/comments/241537612","html_url":"https://github.com/aws/amazon-ecs-agent/issues/501#issuecomment-241537612","issue_url":"https://api.github.com/repos/aws/amazon-ecs-agent/issues/501","id":241537612,"user":{"login":"ziggythehamster","id":66674,"avatar_url":"https://avatars.githubusercontent.com/u/66674?v=3","gravatar_id":"","url":"https://api.github.com/users/ziggythehamster","html_url":"https://github.com/ziggythehamster","followers_url":"https://api.github.com/users/ziggythehamster/followers","following_url":"https://api.github.com/users/ziggythehamster/following{/other_user}","gists_url":"https://api.github.com/users/ziggythehamster/gists{/gist_id}","starred_url":"https://api.github.com/users/ziggythehamster/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ziggythehamster/subscriptions","organizations_url":"https://api.github.com/users/ziggythehamster/orgs","repos_url":"https://api.github.com/users/ziggythehamster/repos","events_url":"https://api.github.com/users/ziggythehamster/events{/privacy}","received_events_url":"https://api.github.com/users/ziggythehamster/received_events","type":"User","site_admin":false},"created_at":"2016-08-22T20:22:16Z","updated_at":"2016-08-22T20:22:16Z","body":"I see this behavior as well, but don't have any of the same precursors as OP, and suspect it's related to #488 since I haven't seen it after changing the default container `nofiles` ulimit to an excessively high number (65,536) via `/etc/sysconfig/docker`."}}
{"actor":{"display_login":"ziggythehamster"}}