{"action":"created","issue":{"url":"https://api.github.com/repos/apache/reef/issues/1201","repository_url":"https://api.github.com/repos/apache/reef","labels_url":"https://api.github.com/repos/apache/reef/issues/1201/labels{/name}","comments_url":"https://api.github.com/repos/apache/reef/issues/1201/comments","events_url":"https://api.github.com/repos/apache/reef/issues/1201/events","html_url":"https://github.com/apache/reef/pull/1201","id":194469442,"number":1201,"title":"[REEF-1511] Timeout for Task shutdown during IMRU recovery","user":{"login":"jwang98052","id":5666504,"avatar_url":"https://avatars.githubusercontent.com/u/5666504?v=3","gravatar_id":"","url":"https://api.github.com/users/jwang98052","html_url":"https://github.com/jwang98052","followers_url":"https://api.github.com/users/jwang98052/followers","following_url":"https://api.github.com/users/jwang98052/following{/other_user}","gists_url":"https://api.github.com/users/jwang98052/gists{/gist_id}","starred_url":"https://api.github.com/users/jwang98052/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jwang98052/subscriptions","organizations_url":"https://api.github.com/users/jwang98052/orgs","repos_url":"https://api.github.com/users/jwang98052/repos","events_url":"https://api.github.com/users/jwang98052/events{/privacy}","received_events_url":"https://api.github.com/users/jwang98052/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2016-12-08T23:10:00Z","updated_at":"2016-12-09T22:45:12Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/reef/pulls/1201","html_url":"https://github.com/apache/reef/pull/1201","diff_url":"https://github.com/apache/reef/pull/1201.diff","patch_url":"https://github.com/apache/reef/pull/1201.patch"},"body":"During IMRU FT recovery, sometimes the tasks that supposed to close by driver don't send completed event back, causing the system hang. This PR adds the timeout for tasks closed by driver, and kill the evaluator if timeout.\r\n\r\nThe average closing time is recorded in the TaskManager. This number is a reference for define the time out on the fly. In case the average number is accessed before the average data is accumulated, or the average number is too low in some scenarios, we also have a configurable MinTaskWaitingForCloseTimeout to ensure the driver wait for enough time before killing the evaluator.\r\n\r\nJIRA: [REEF-1511](https://issues.apache.org/jira/browse/REEF-1511)\r\nThis closes  #"},"comment":{"url":"https://api.github.com/repos/apache/reef/issues/comments/266143920","html_url":"https://github.com/apache/reef/pull/1201#issuecomment-266143920","issue_url":"https://api.github.com/repos/apache/reef/issues/1201","id":266143920,"user":{"login":"tcNickolas","id":10113024,"avatar_url":"https://avatars.githubusercontent.com/u/10113024?v=3","gravatar_id":"","url":"https://api.github.com/users/tcNickolas","html_url":"https://github.com/tcNickolas","followers_url":"https://api.github.com/users/tcNickolas/followers","following_url":"https://api.github.com/users/tcNickolas/following{/other_user}","gists_url":"https://api.github.com/users/tcNickolas/gists{/gist_id}","starred_url":"https://api.github.com/users/tcNickolas/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tcNickolas/subscriptions","organizations_url":"https://api.github.com/users/tcNickolas/orgs","repos_url":"https://api.github.com/users/tcNickolas/repos","events_url":"https://api.github.com/users/tcNickolas/events{/privacy}","received_events_url":"https://api.github.com/users/tcNickolas/received_events","type":"User","site_admin":false},"created_at":"2016-12-09T22:45:12Z","updated_at":"2016-12-09T22:45:12Z","body":"Please check why `TestTaskManager.TestTasksClosingTime()` fails in all 4 AppVeyor runs for this pull request."}}
{"actor":{"display_login":"tcNickolas"}}