{"action":"closed","issue":{"url":"https://api.github.com/repos/aws/amazon-ecs-agent/issues/490","repository_url":"https://api.github.com/repos/aws/amazon-ecs-agent","labels_url":"https://api.github.com/repos/aws/amazon-ecs-agent/issues/490/labels{/name}","comments_url":"https://api.github.com/repos/aws/amazon-ecs-agent/issues/490/comments","events_url":"https://api.github.com/repos/aws/amazon-ecs-agent/issues/490/events","html_url":"https://github.com/aws/amazon-ecs-agent/issues/490","id":171732128,"number":490,"title":"Flaky test: TestSendsEvents","user":{"login":"samuelkarp","id":737750,"avatar_url":"https://avatars.githubusercontent.com/u/737750?v=3","gravatar_id":"","url":"https://api.github.com/users/samuelkarp","html_url":"https://github.com/samuelkarp","followers_url":"https://api.github.com/users/samuelkarp/followers","following_url":"https://api.github.com/users/samuelkarp/following{/other_user}","gists_url":"https://api.github.com/users/samuelkarp/gists{/gist_id}","starred_url":"https://api.github.com/users/samuelkarp/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/samuelkarp/subscriptions","organizations_url":"https://api.github.com/users/samuelkarp/orgs","repos_url":"https://api.github.com/users/samuelkarp/repos","events_url":"https://api.github.com/users/samuelkarp/events{/privacy}","received_events_url":"https://api.github.com/users/samuelkarp/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2016-08-17T18:49:48Z","updated_at":"2016-10-04T22:24:01Z","closed_at":"2016-10-04T22:24:01Z","body":"```\r\n=== RUN   TestSendsEvents\r\n2016-08-17T00:32:09Z [INFO] Adding event module=\"eventhandler\" change=\"ContainerChange: 1 containerName -> RUNNING\"\r\n2016-08-17T00:32:09Z [INFO] Sending container change module=\"eventhandler\" event=\"ContainerChange: 1 containerName -> RUNNING\" change=\"ContainerChange: 1 containerName -> RUNNING\"\r\n2016-08-17T00:32:09Z [INFO] Adding event module=\"eventhandler\" change=\"ContainerChange: 2 containerName -> RUNNING\"\r\n2016-08-17T00:32:09Z [INFO] Adding event module=\"eventhandler\" change=\"TaskChange: 2 -> RUNNING\"\r\n2016-08-17T00:32:09Z [INFO] Sending container change module=\"eventhandler\" event=\"ContainerChange: 2 containerName -> RUNNING\" change=\"ContainerChange: 2 containerName -> RUNNING\"\r\n2016-08-17T00:32:09Z [INFO] Sending task change module=\"eventhandler\" event=\"TaskChange: 2 -> RUNNING\" change=\"TaskChange: 2 -> RUNNING\"\r\n2016-08-17T00:32:09Z [INFO] Adding event module=\"eventhandler\" change=\"ContainerChange: 3 containerName -> RUNNING\"\r\n2016-08-17T00:32:09Z [INFO] Sending container change module=\"eventhandler\" event=\"ContainerChange: 3 containerName -> RUNNING\" change=\"ContainerChange: 3 containerName -> RUNNING\"\r\n2016-08-17T00:32:09Z [ERROR] Unretriable error submitting container state change module=\"eventhandler\" event=\"ContainerChange: 3 containerName -> RUNNING\" err=\"test\"\r\n2016-08-17T00:32:10Z [INFO] Sending container change module=\"eventhandler\" event=\"ContainerChange: 3 containerName -> RUNNING\" change=\"ContainerChange: 3 containerName -> RUNNING\"\r\n2016-08-17T00:32:10Z [INFO] Adding event module=\"eventhandler\" change=\"ContainerChange: concurrent_0 containerName -> RUNNING\"\r\n2016-08-17T00:32:10Z [INFO] Adding event module=\"eventhandler\" change=\"ContainerChange: concurrent_1 containerName -> RUNNING\"\r\n2016-08-17T00:32:10Z [INFO] Adding event module=\"eventhandler\" change=\"ContainerChange: concurrent_2 containerName -> RUNNING\"\r\n2016-08-17T00:32:10Z [INFO] Adding event module=\"eventhandler\" change=\"ContainerChange: concurrent_3 containerName -> RUNNING\"\r\n2016-08-17T00:32:10Z [INFO] Sending container change module=\"eventhandler\" event=\"ContainerChange: concurrent_3 containerName -> RUNNING\" change=\"ContainerChange: concurrent_3 containerName -> RUNNING\"\r\n2016-08-17T00:32:10Z [INFO] Sending container change module=\"eventhandler\" event=\"ContainerChange: concurrent_0 containerName -> RUNNING\" change=\"ContainerChange: concurrent_0 containerName -> RUNNING\"\r\n2016-08-17T00:32:10Z [INFO] Sending container change module=\"eventhandler\" event=\"ContainerChange: concurrent_1 containerName -> RUNNING\" change=\"ContainerChange: concurrent_1 containerName -> RUNNING\"\r\n2016-08-17T00:32:10Z [INFO] Sending container change module=\"eventhandler\" event=\"ContainerChange: concurrent_2 containerName -> RUNNING\" change=\"ContainerChange: concurrent_2 containerName -> RUNNING\"\r\n2016-08-17T00:32:10Z [INFO] Adding event module=\"eventhandler\" change=\"ContainerChange: notreplaced1 containerName -> RUNNING\"\r\n2016-08-17T00:32:10Z [INFO] Adding event module=\"eventhandler\" change=\"ContainerChange: notreplaced1 containerName -> STOPPED\"\r\n2016-08-17T00:32:10Z [INFO] Sending container change module=\"eventhandler\" event=\"ContainerChange: notreplaced1 containerName -> RUNNING\" change=\"ContainerChange: notreplaced1 containerName -> RUNNING\"\r\n2016-08-17T00:32:10Z [INFO] Sending container change module=\"eventhandler\" event=\"ContainerChange: notreplaced1 containerName -> STOPPED\" change=\"ContainerChange: notreplaced1 containerName -> STOPPED\"\r\n2016-08-17T00:32:10Z [ERROR] Unretriable error submitting container state change module=\"eventhandler\" event=\"ContainerChange: notreplaced1 containerName -> STOPPED\" err=\"test\"\r\n2016-08-17T00:32:11Z [INFO] Sending container change module=\"eventhandler\" event=\"ContainerChange: notreplaced1 containerName -> STOPPED\" change=\"ContainerChange: notreplaced1 containerName -> STOPPED\"\r\n2016-08-17T00:32:11Z [INFO] Adding event module=\"eventhandler\" change=\"ContainerChange: notreplaced2 containerName -> RUNNING\"\r\n2016-08-17T00:32:11Z [INFO] Adding event module=\"eventhandler\" change=\"TaskChange: notreplaced2 -> RUNNING\"\r\n2016-08-17T00:32:11Z [INFO] Adding event module=\"eventhandler\" change=\"ContainerChange: notreplaced2 containerName -> STOPPED\"\r\n2016-08-17T00:32:11Z [INFO] Sending container change module=\"eventhandler\" event=\"ContainerChange: notreplaced2 containerName -> RUNNING\" change=\"ContainerChange: notreplaced2 containerName -> RUNNING\"\r\n2016-08-17T00:32:11Z [INFO] Adding event module=\"eventhandler\" change=\"TaskChange: notreplaced2 -> STOPPED\"\r\npanic: test timed out after 3m0s\r\n\r\ngoroutine 25 [running]:\r\ntesting.startAlarm.func1()\r\n\t/usr/lib/golang/src/testing/testing.go:703 +0x132\r\ncreated by time.goFunc\r\n\t/usr/lib/golang/src/time/sleep.go:129 +0x3a\r\n\r\ngoroutine 1 [chan receive]:\r\ntesting.RunTests(0x9f5c00, 0xb81e60, 0x2, 0x2, 0xc820076d01)\r\n\t/usr/lib/golang/src/testing/testing.go:562 +0x8ad\r\ntesting.(*M).Run(0xc8200a1ee8, 0xb8a4e0)\r\n\t/usr/lib/golang/src/testing/testing.go:494 +0x70\r\nmain.main()\r\n\tgithub.com/aws/amazon-ecs-agent/agent/eventhandler/_test/_testmain.go:106 +0x252\r\n\r\ngoroutine 17 [syscall, locked to thread]:\r\nruntime.goexit()\r\n\t/usr/lib/golang/src/runtime/asm_amd64.s:1721 +0x1\r\n\r\ngoroutine 5 [semacquire]:\r\nsync.runtime_Syncsemacquire(0xc8200ca350)\r\n\t/usr/lib/golang/src/runtime/sema.go:237 +0x201\r\nsync.(*Cond).Wait(0xc8200ca340)\r\n\t/usr/lib/golang/src/sync/cond.go:62 +0x9b\r\ngithub.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processItem(0xc820014a20, 0x0)\r\n\t/opt/amazon-ecs-agent/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xc7\r\ngithub.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc820014a20)\r\n\t/opt/amazon-ecs-agent/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x2a\r\ncreated by github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.newAsyncLoopLogger\r\n\t/opt/amazon-ecs-agent/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x91\r\n\r\ngoroutine 6 [semacquire]:\r\nsync.runtime_Syncsemacquire(0xc8200ca4d0)\r\n\t/usr/lib/golang/src/runtime/sema.go:237 +0x201\r\nsync.(*Cond).Wait(0xc8200ca4c0)\r\n\t/usr/lib/golang/src/sync/cond.go:62 +0x9b\r\ngithub.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processItem(0xc820014b40, 0x0)\r\n\t/opt/amazon-ecs-agent/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xc7\r\ngithub.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc820014b40)\r\n\t/opt/amazon-ecs-agent/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x2a\r\ncreated by github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.newAsyncLoopLogger\r\n\t/opt/amazon-ecs-agent/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x91\r\n\r\ngoroutine 7 [semacquire]:\r\nsync.runtime_Syncsemacquire(0xc8200caad0)\r\n\t/usr/lib/golang/src/runtime/sema.go:237 +0x201\r\nsync.(*Cond).Wait(0xc8200caac0)\r\n\t/usr/lib/golang/src/sync/cond.go:62 +0x9b\r\ngithub.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processItem(0xc820014cc0, 0x0)\r\n\t/opt/amazon-ecs-agent/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xc7\r\ngithub.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc820014cc0)\r\n\t/opt/amazon-ecs-agent/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x2a\r\ncreated by github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.newAsyncLoopLogger\r\n\t/opt/amazon-ecs-agent/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x91\r\n\r\ngoroutine 9 [semacquire]:\r\nsync.runtime_Semacquire(0xc820122128)\r\n\t/usr/lib/golang/src/runtime/sema.go:43 +0x26\r\nsync.(*Mutex).Lock(0xc820122124)\r\n\t/usr/lib/golang/src/sync/mutex.go:82 +0x1c4\r\ngithub.com/aws/amazon-ecs-agent/agent/eventhandler.addEvent(0xc82010a640, 0x7f9dbe3160d0, 0xc8200c9f70)\r\n\tgithub.com/aws/amazon-ecs-agent/agent/eventhandler/_test/_obj_test/task_handler.go:66 +0x1a8\r\ngithub.com/aws/amazon-ecs-agent/agent/eventhandler.AddTaskEvent(0x929920, 0xc, 0x4, 0x0, 0x0, 0x0, 0x7f9dbe3160d0, 0xc8200c9f70)\r\n\tgithub.com/aws/amazon-ecs-agent/agent/eventhandler/_test/_obj_test/task_handler.go:34 +0x138\r\ngithub.com/aws/amazon-ecs-agent/agent/eventhandler.TestSendsEvents(0xc8200786c0)\r\n\t/opt/amazon-ecs-agent/go/src/github.com/aws/amazon-ecs-agent/agent/eventhandler/handler_test.go:274 +0x253a\r\ntesting.tRunner(0xc8200786c0, 0xb81e60)\r\n\t/usr/lib/golang/src/testing/testing.go:456 +0x98\r\ncreated by testing.RunTests\r\n\t/usr/lib/golang/src/testing/testing.go:561 +0x86d\r\n\r\ngoroutine 37 [chan receive]:\r\ngithub.com/aws/amazon-ecs-agent/agent/eventhandler.TestSendsEvents.func3(0x929920, 0xc, 0x925670, 0xd, 0x3, 0x0, 0x0, 0x0, 0x0, 0x0, ...)\r\n\t/opt/amazon-ecs-agent/go/src/github.com/aws/amazon-ecs-agent/agent/eventhandler/handler_test.go:112 +0x9a\r\ngithub.com/aws/amazon-ecs-agent/agent/eventhandler.(*MockECSClient).SubmitContainerStateChange(0xc8200c9f70, 0x929920, 0xc, 0x925670, 0xd, 0x3, 0x0, 0x0, 0x0, 0x0, ...)\r\n\t/opt/amazon-ecs-agent/go/src/github.com/aws/amazon-ecs-agent/agent/eventhandler/handler_test.go:49 +0x43\r\ngithub.com/aws/amazon-ecs-agent/agent/eventhandler.SubmitTaskEvents.func1(0x0, 0x0)\r\n\tgithub.com/aws/amazon-ecs-agent/agent/eventhandler/_test/_obj_test/task_handler.go:121 +0x639\r\ngithub.com/aws/amazon-ecs-agent/agent/utils.RetryWithBackoff(0x7f9dbe316210, 0xc8201260f0, 0xc820119f50, 0x0, 0x0)\r\n\t/opt/amazon-ecs-agent/go/src/github.com/aws/amazon-ecs-agent/agent/utils/utils.go:112 +0x3c\r\ngithub.com/aws/amazon-ecs-agent/agent/eventhandler.SubmitTaskEvents(0xc820122120, 0x7f9dbe3160d0, 0xc8200c9f70)\r\n\tgithub.com/aws/amazon-ecs-agent/agent/eventhandler/_test/_obj_test/task_handler.go:181 +0x142\r\ncreated by github.com/aws/amazon-ecs-agent/agent/eventhandler.addEvent\r\n\tgithub.com/aws/amazon-ecs-agent/agent/eventhandler/_test/_obj_test/task_handler.go:74 +0x27d\r\nFAIL\tgithub.com/aws/amazon-ecs-agent/agent/eventhandler\t180.006s\r\n```"}}
{"actor":{"display_login":"samuelkarp"}}