{"action":"created","issue":{"url":"https://api.github.com/repos/YellProgram/Yell/issues/49","repository_url":"https://api.github.com/repos/YellProgram/Yell","labels_url":"https://api.github.com/repos/YellProgram/Yell/issues/49/labels{/name}","comments_url":"https://api.github.com/repos/YellProgram/Yell/issues/49/comments","events_url":"https://api.github.com/repos/YellProgram/Yell/issues/49/events","html_url":"https://github.com/YellProgram/Yell/issues/49","id":367207560,"node_id":"MDU6SXNzdWUzNjcyMDc1NjA=","number":49,"title":"Memory allocation","user":{"login":"k-eks","id":12133169,"node_id":"MDQ6VXNlcjEyMTMzMTY5","avatar_url":"https://avatars2.githubusercontent.com/u/12133169?v=4","gravatar_id":"","url":"https://api.github.com/users/k-eks","html_url":"https://github.com/k-eks","followers_url":"https://api.github.com/users/k-eks/followers","following_url":"https://api.github.com/users/k-eks/following{/other_user}","gists_url":"https://api.github.com/users/k-eks/gists{/gist_id}","starred_url":"https://api.github.com/users/k-eks/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/k-eks/subscriptions","organizations_url":"https://api.github.com/users/k-eks/orgs","repos_url":"https://api.github.com/users/k-eks/repos","events_url":"https://api.github.com/users/k-eks/events{/privacy}","received_events_url":"https://api.github.com/users/k-eks/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-10-05T13:17:56Z","updated_at":"2018-10-05T14:57:30Z","closed_at":null,"author_association":"NONE","body":"I have observed it several times now that memory consumption seems to be erratic. When I submit yell calculations to the ETH computing cluster, some of them get killed because of too much memory allocation. In theory, no model that I submitted should consume more than 16 GB of memory at a peak moment. Now I have submitted a model (with a theoretical memory consumption of about 8 GB), it got rejected again because of too much memory allocation and resubmitted it with a request for more memory allocation (28 GB). It worked without a glitch and only used about  8 GB. Protocols below.\r\n\r\nRejected run\r\n```\r\nJob </cluster/home/messmerd/yell> was submitted from host <eu-login-14-ng> by user <messmerd> in cluster <euler> at Thu Oct  4 17:52:39 2018.\r\nJob was executed on host(s) <eu-ms-018-45>, in queue <normal.24h>, as user <messmerd> in cluster <euler> at Thu Oct  4 17:53:10 2018.\r\n</cluster/home/messmerd> was used as the home directory.\r\n</cluster/scratch/messmerd/daniel/model1> was used as the working directory.\r\nStarted at Thu Oct  4 17:53:10 2018.\r\nTerminated at Thu Oct  4 17:53:42 2018.\r\nResults reported at Thu Oct  4 17:53:42 2018.\r\n\r\nYour job looked like:\r\n\r\n------------------------------------------------------------\r\n# LSBATCH: User input\r\n/cluster/home/messmerd/yell\r\n------------------------------------------------------------\r\n\r\nTERM_MEMLIMIT: job killed after reaching LSF memory usage limit.\r\nExited with exit code 130.\r\n\r\nResource usage summary:\r\n\r\n   CPU time :                                   24.00 sec.\r\n   Max Memory :                                 30500 MB\r\n   Average Memory :                             1061.00 MB\r\n   Total Requested Memory :                     14000.00 MB\r\n   Delta Memory :                               -16500.00 MB\r\n   Max Swap :                                   -\r\n   Max Processes :                              3\r\n   Max Threads :                                4\r\n   Run time :                                   53 sec.\r\n   Turnaround time :                            63 sec.\r\n\r\nRead file <lsf.o74779711> for stdout and stderr output of this job.\r\n```\r\n\r\nSame model, more memory, successful run, less memory consumption than before\r\n```\r\nJob </cluster/home/messmerd/yell> was submitted from host <eu-login-14-ng> by user <messmerd> in cluster <euler> at Thu Oct  4 17:56:45 2018.\r\nJob was executed on host(s) <eu-ms-006-25>, in queue <normal.24h>, as user <messmerd> in cluster <euler> at Fri Oct  5 06:13:34 2018.\r\n</cluster/home/messmerd> was used as the home directory.\r\n</cluster/scratch/messmerd/daniel/model1> was used as the working directory.\r\nStarted at Fri Oct  5 06:13:34 2018.\r\nTerminated at Fri Oct  5 09:29:15 2018.\r\nResults reported at Fri Oct  5 09:29:15 2018.\r\n\r\nYour job looked like:\r\n\r\n------------------------------------------------------------\r\n# LSBATCH: User input\r\n/cluster/home/messmerd/yell\r\n------------------------------------------------------------\r\n\r\nSuccessfully completed.\r\n\r\nResource usage summary:\r\n\r\n   CPU time :                                   11734.86 sec.\r\n   Max Memory :                                 8384 MB\r\n   Average Memory :                             7260.04 MB\r\n   Total Requested Memory :                     28000.00 MB\r\n   Delta Memory :                               19616.00 MB\r\n   Max Swap :                                   -\r\n   Max Processes :                              3\r\n   Max Threads :                                4\r\n   Run time :                                   11759 sec.\r\n   Turnaround time :                            55950 sec.\r\n\r\nRead file <lsf.o74780342> for stdout and stderr output of this job.\r\n```\r\n"},"comment":{"url":"https://api.github.com/repos/YellProgram/Yell/issues/comments/427394718","html_url":"https://github.com/YellProgram/Yell/issues/49#issuecomment-427394718","issue_url":"https://api.github.com/repos/YellProgram/Yell/issues/49","id":427394718,"node_id":"MDEyOklzc3VlQ29tbWVudDQyNzM5NDcxOA==","user":{"login":"aglie","id":2978725,"node_id":"MDQ6VXNlcjI5Nzg3MjU=","avatar_url":"https://avatars1.githubusercontent.com/u/2978725?v=4","gravatar_id":"","url":"https://api.github.com/users/aglie","html_url":"https://github.com/aglie","followers_url":"https://api.github.com/users/aglie/followers","following_url":"https://api.github.com/users/aglie/following{/other_user}","gists_url":"https://api.github.com/users/aglie/gists{/gist_id}","starred_url":"https://api.github.com/users/aglie/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/aglie/subscriptions","organizations_url":"https://api.github.com/users/aglie/orgs","repos_url":"https://api.github.com/users/aglie/repos","events_url":"https://api.github.com/users/aglie/events{/privacy}","received_events_url":"https://api.github.com/users/aglie/received_events","type":"User","site_admin":false},"created_at":"2018-10-05T14:57:30Z","updated_at":"2018-10-05T14:57:30Z","author_association":"CONTRIBUTOR","body":"Oh, great you pinpointed it.\r\n\r\nCould you save this particular model please? I will take a look when I am reconnected with my compilation pipeline."}}
{"actor":{"display_login":"aglie"}}