{"action":"created","issue":{"url":"https://api.github.com/repos/fluo-io/webindex/issues/42","repository_url":"https://api.github.com/repos/fluo-io/webindex","labels_url":"https://api.github.com/repos/fluo-io/webindex/issues/42/labels{/name}","comments_url":"https://api.github.com/repos/fluo-io/webindex/issues/42/comments","events_url":"https://api.github.com/repos/fluo-io/webindex/issues/42/events","html_url":"https://github.com/fluo-io/webindex/issues/42","id":125967639,"number":42,"title":"Investigate memory issue","user":{"login":"keith-turner","id":1268739,"avatar_url":"https://avatars.githubusercontent.com/u/1268739?v=3","gravatar_id":"","url":"https://api.github.com/users/keith-turner","html_url":"https://github.com/keith-turner","followers_url":"https://api.github.com/users/keith-turner/followers","following_url":"https://api.github.com/users/keith-turner/following{/other_user}","gists_url":"https://api.github.com/users/keith-turner/gists{/gist_id}","starred_url":"https://api.github.com/users/keith-turner/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/keith-turner/subscriptions","organizations_url":"https://api.github.com/users/keith-turner/orgs","repos_url":"https://api.github.com/users/keith-turner/repos","events_url":"https://api.github.com/users/keith-turner/events{/privacy}","received_events_url":"https://api.github.com/users/keith-turner/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-01-11T15:23:17Z","updated_at":"2016-05-13T03:16:09Z","closed_at":"2016-05-13T03:16:09Z","body":"While running a 3 day experiment with Webindex on EC2, I noticed that workers were constantly being killed for using two much memory.  I started off with 128 threads and 4G per workers.   I increased to 5G and then 6G and workers were still being killed or dying.\r\n\r\nWhen the workers had 4G and were being killed I looked in the YARN logs to determine why and found it was memory usage.   After increasing the memory, I noticed they were still dying (based on attempt count in task ID).  However I did not inspect YARN logs again to verify it was memory related, I should have."},"comment":{"url":"https://api.github.com/repos/fluo-io/webindex/issues/comments/218942382","html_url":"https://github.com/fluo-io/webindex/issues/42#issuecomment-218942382","issue_url":"https://api.github.com/repos/fluo-io/webindex/issues/42","id":218942382,"user":{"login":"keith-turner","id":1268739,"avatar_url":"https://avatars.githubusercontent.com/u/1268739?v=3","gravatar_id":"","url":"https://api.github.com/users/keith-turner","html_url":"https://github.com/keith-turner","followers_url":"https://api.github.com/users/keith-turner/followers","following_url":"https://api.github.com/users/keith-turner/following{/other_user}","gists_url":"https://api.github.com/users/keith-turner/gists{/gist_id}","starred_url":"https://api.github.com/users/keith-turner/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/keith-turner/subscriptions","organizations_url":"https://api.github.com/users/keith-turner/orgs","repos_url":"https://api.github.com/users/keith-turner/repos","events_url":"https://api.github.com/users/keith-turner/events{/privacy}","received_events_url":"https://api.github.com/users/keith-turner/received_events","type":"User","site_admin":false},"created_at":"2016-05-13T03:16:09Z","updated_at":"2016-05-13T03:16:09Z","body":"Resolved by fluo-io/fluo#648"}}