{"action":"closed","issue":{"url":"https://api.github.com/repos/gem/oq-engine/issues/2214","repository_url":"https://api.github.com/repos/gem/oq-engine","labels_url":"https://api.github.com/repos/gem/oq-engine/issues/2214/labels{/name}","comments_url":"https://api.github.com/repos/gem/oq-engine/issues/2214/comments","events_url":"https://api.github.com/repos/gem/oq-engine/issues/2214/events","html_url":"https://github.com/gem/oq-engine/issues/2214","id":174887718,"number":2214,"title":"Do not transfer rlzs_by_gsims: sending the GSIMs is enough","user":{"login":"micheles","id":2463856,"avatar_url":"https://avatars.githubusercontent.com/u/2463856?v=3","gravatar_id":"","url":"https://api.github.com/users/micheles","html_url":"https://github.com/micheles","followers_url":"https://api.github.com/users/micheles/followers","following_url":"https://api.github.com/users/micheles/following{/other_user}","gists_url":"https://api.github.com/users/micheles/gists{/gist_id}","starred_url":"https://api.github.com/users/micheles/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/micheles/subscriptions","organizations_url":"https://api.github.com/users/micheles/orgs","repos_url":"https://api.github.com/users/micheles/repos","events_url":"https://api.github.com/users/micheles/events{/privacy}","received_events_url":"https://api.github.com/users/micheles/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/gem/oq-engine/labels/enhancement","name":"enhancement","color":"009800"}],"state":"closed","locked":false,"assignee":{"login":"micheles","id":2463856,"avatar_url":"https://avatars.githubusercontent.com/u/2463856?v=3","gravatar_id":"","url":"https://api.github.com/users/micheles","html_url":"https://github.com/micheles","followers_url":"https://api.github.com/users/micheles/followers","following_url":"https://api.github.com/users/micheles/following{/other_user}","gists_url":"https://api.github.com/users/micheles/gists{/gist_id}","starred_url":"https://api.github.com/users/micheles/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/micheles/subscriptions","organizations_url":"https://api.github.com/users/micheles/orgs","repos_url":"https://api.github.com/users/micheles/repos","events_url":"https://api.github.com/users/micheles/events{/privacy}","received_events_url":"https://api.github.com/users/micheles/received_events","type":"User","site_admin":false},"assignees":[{"login":"micheles","id":2463856,"avatar_url":"https://avatars.githubusercontent.com/u/2463856?v=3","gravatar_id":"","url":"https://api.github.com/users/micheles","html_url":"https://github.com/micheles","followers_url":"https://api.github.com/users/micheles/followers","following_url":"https://api.github.com/users/micheles/following{/other_user}","gists_url":"https://api.github.com/users/micheles/gists{/gist_id}","starred_url":"https://api.github.com/users/micheles/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/micheles/subscriptions","organizations_url":"https://api.github.com/users/micheles/orgs","repos_url":"https://api.github.com/users/micheles/repos","events_url":"https://api.github.com/users/micheles/events{/privacy}","received_events_url":"https://api.github.com/users/micheles/received_events","type":"User","site_admin":false}],"milestone":{"url":"https://api.github.com/repos/gem/oq-engine/milestones/9","html_url":"https://github.com/gem/oq-engine/milestones/Engine%202.1.0","labels_url":"https://api.github.com/repos/gem/oq-engine/milestones/9/labels","id":1768969,"number":9,"title":"Engine 2.1.0","description":"","creator":{"login":"daniviga","id":1818657,"avatar_url":"https://avatars.githubusercontent.com/u/1818657?v=3","gravatar_id":"","url":"https://api.github.com/users/daniviga","html_url":"https://github.com/daniviga","followers_url":"https://api.github.com/users/daniviga/followers","following_url":"https://api.github.com/users/daniviga/following{/other_user}","gists_url":"https://api.github.com/users/daniviga/gists{/gist_id}","starred_url":"https://api.github.com/users/daniviga/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/daniviga/subscriptions","organizations_url":"https://api.github.com/users/daniviga/orgs","repos_url":"https://api.github.com/users/daniviga/repos","events_url":"https://api.github.com/users/daniviga/events{/privacy}","received_events_url":"https://api.github.com/users/daniviga/received_events","type":"User","site_admin":false},"open_issues":7,"closed_issues":98,"state":"open","created_at":"2016-05-16T15:07:47Z","updated_at":"2016-09-05T08:08:46Z","due_on":null,"closed_at":null},"comments":4,"created_at":"2016-09-03T09:11:26Z","updated_at":"2016-09-05T08:08:46Z","closed_at":"2016-09-05T08:08:46Z","body":"Here is the data transfer for the full SHARE calculation (job 12178):\r\n\r\n```\r\nclassical_num_tasks             4,997\r\nclassical_sent.monitor          21,316,947\r\nclassical_sent.rlzs_by_gsim     1,101,661,458\r\nclassical_sent.sitecol          7,370,695,384\r\nclassical_sent.sources          1,043,377,267\r\nclassical_tot_received          97,689,980,824\r\n```\r\n\r\nThe dominating factor is the site collection (~ 7 GB) but even rlzs_by_gsim (~1 GB) is larger than the data transfer in the sources while it should not be. The data transfer back is huge (~91 GB) but it is already very optimized. It would be nice to have a better task distribution so that we could afford to run the computation with say 5 times less tasks and 5 times less data transfer."}}
{"actor":{"display_login":"micheles"}}