{"action":"created","issue":{"url":"https://api.github.com/repos/HumanCellAtlas/matrix-service/issues/139","repository_url":"https://api.github.com/repos/HumanCellAtlas/matrix-service","labels_url":"https://api.github.com/repos/HumanCellAtlas/matrix-service/issues/139/labels{/name}","comments_url":"https://api.github.com/repos/HumanCellAtlas/matrix-service/issues/139/comments","events_url":"https://api.github.com/repos/HumanCellAtlas/matrix-service/issues/139/events","html_url":"https://github.com/HumanCellAtlas/matrix-service/issues/139","id":381681305,"node_id":"MDU6SXNzdWUzODE2ODEzMDU=","number":139,"title":"Profile memory utilization of worker daemon","user":{"login":"parthshahva","id":6373241,"node_id":"MDQ6VXNlcjYzNzMyNDE=","avatar_url":"https://avatars2.githubusercontent.com/u/6373241?v=4","gravatar_id":"","url":"https://api.github.com/users/parthshahva","html_url":"https://github.com/parthshahva","followers_url":"https://api.github.com/users/parthshahva/followers","following_url":"https://api.github.com/users/parthshahva/following{/other_user}","gists_url":"https://api.github.com/users/parthshahva/gists{/gist_id}","starred_url":"https://api.github.com/users/parthshahva/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/parthshahva/subscriptions","organizations_url":"https://api.github.com/users/parthshahva/orgs","repos_url":"https://api.github.com/users/parthshahva/repos","events_url":"https://api.github.com/users/parthshahva/events{/privacy}","received_events_url":"https://api.github.com/users/parthshahva/received_events","type":"User","site_admin":false},"labels":[{"id":1108917733,"node_id":"MDU6TGFiZWwxMTA4OTE3NzMz","url":"https://api.github.com/repos/HumanCellAtlas/matrix-service/labels/Low","name":"Low","color":"f7d5ad","default":false}],"state":"open","locked":false,"assignee":{"login":"parthshahva","id":6373241,"node_id":"MDQ6VXNlcjYzNzMyNDE=","avatar_url":"https://avatars2.githubusercontent.com/u/6373241?v=4","gravatar_id":"","url":"https://api.github.com/users/parthshahva","html_url":"https://github.com/parthshahva","followers_url":"https://api.github.com/users/parthshahva/followers","following_url":"https://api.github.com/users/parthshahva/following{/other_user}","gists_url":"https://api.github.com/users/parthshahva/gists{/gist_id}","starred_url":"https://api.github.com/users/parthshahva/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/parthshahva/subscriptions","organizations_url":"https://api.github.com/users/parthshahva/orgs","repos_url":"https://api.github.com/users/parthshahva/repos","events_url":"https://api.github.com/users/parthshahva/events{/privacy}","received_events_url":"https://api.github.com/users/parthshahva/received_events","type":"User","site_admin":false},"assignees":[{"login":"parthshahva","id":6373241,"node_id":"MDQ6VXNlcjYzNzMyNDE=","avatar_url":"https://avatars2.githubusercontent.com/u/6373241?v=4","gravatar_id":"","url":"https://api.github.com/users/parthshahva","html_url":"https://github.com/parthshahva","followers_url":"https://api.github.com/users/parthshahva/followers","following_url":"https://api.github.com/users/parthshahva/following{/other_user}","gists_url":"https://api.github.com/users/parthshahva/gists{/gist_id}","starred_url":"https://api.github.com/users/parthshahva/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/parthshahva/subscriptions","organizations_url":"https://api.github.com/users/parthshahva/orgs","repos_url":"https://api.github.com/users/parthshahva/repos","events_url":"https://api.github.com/users/parthshahva/events{/privacy}","received_events_url":"https://api.github.com/users/parthshahva/received_events","type":"User","site_admin":false}],"milestone":null,"comments":1,"created_at":"2018-11-16T16:56:03Z","updated_at":"2018-12-21T19:36:05Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"Currently, the worker daemon is set to utilize 3gb of memory. Regardless of how much memory is actually utilized, AWS will charge us for the full memory reservation. We should profile the worker daemon to investigate why this high memory limit is required. There are some python tools that can help us here. We should also dig into the logs to see what the distribution of memory usage is historically (lambda logs output this in the last line of each invocation). \r\n\r\nRequirement for done: Either we fix the issue and reduce memory utilization or record why we need to maintain this limit of 3gb"},"comment":{"url":"https://api.github.com/repos/HumanCellAtlas/matrix-service/issues/comments/449479503","html_url":"https://github.com/HumanCellAtlas/matrix-service/issues/139#issuecomment-449479503","issue_url":"https://api.github.com/repos/HumanCellAtlas/matrix-service/issues/139","id":449479503,"node_id":"MDEyOklzc3VlQ29tbWVudDQ0OTQ3OTUwMw==","user":{"login":"parthshahva","id":6373241,"node_id":"MDQ6VXNlcjYzNzMyNDE=","avatar_url":"https://avatars2.githubusercontent.com/u/6373241?v=4","gravatar_id":"","url":"https://api.github.com/users/parthshahva","html_url":"https://github.com/parthshahva","followers_url":"https://api.github.com/users/parthshahva/followers","following_url":"https://api.github.com/users/parthshahva/following{/other_user}","gists_url":"https://api.github.com/users/parthshahva/gists{/gist_id}","starred_url":"https://api.github.com/users/parthshahva/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/parthshahva/subscriptions","organizations_url":"https://api.github.com/users/parthshahva/orgs","repos_url":"https://api.github.com/users/parthshahva/repos","events_url":"https://api.github.com/users/parthshahva/events{/privacy}","received_events_url":"https://api.github.com/users/parthshahva/received_events","type":"User","site_admin":false},"created_at":"2018-12-21T19:36:05Z","updated_at":"2018-12-21T19:36:05Z","author_association":"CONTRIBUTOR","body":"Running logs on cloudwatch insights indicates that the max memory used in Prod worker 1784mb and \r\n1895mb over the last 4 weeks. @mckinsel @calvinnhieu  any complaints if I bump us down to 2000mb from 2861mb?"}}
{"actor":{"display_login":"parthshahva"}}