{"action":"created","issue":{"url":"https://api.github.com/repos/jbrzusto/motusServer/issues/77","repository_url":"https://api.github.com/repos/jbrzusto/motusServer","labels_url":"https://api.github.com/repos/jbrzusto/motusServer/issues/77/labels{/name}","comments_url":"https://api.github.com/repos/jbrzusto/motusServer/issues/77/comments","events_url":"https://api.github.com/repos/jbrzusto/motusServer/issues/77/events","html_url":"https://github.com/jbrzusto/motusServer/issues/77","id":198736242,"number":77,"title":"spread subjobs across processors?","user":{"login":"jbrzusto","id":1228504,"avatar_url":"https://avatars2.githubusercontent.com/u/1228504?v=4","gravatar_id":"","url":"https://api.github.com/users/jbrzusto","html_url":"https://github.com/jbrzusto","followers_url":"https://api.github.com/users/jbrzusto/followers","following_url":"https://api.github.com/users/jbrzusto/following{/other_user}","gists_url":"https://api.github.com/users/jbrzusto/gists{/gist_id}","starred_url":"https://api.github.com/users/jbrzusto/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jbrzusto/subscriptions","organizations_url":"https://api.github.com/users/jbrzusto/orgs","repos_url":"https://api.github.com/users/jbrzusto/repos","events_url":"https://api.github.com/users/jbrzusto/events{/privacy}","received_events_url":"https://api.github.com/users/jbrzusto/received_events","type":"User","site_admin":false},"labels":[{"id":395678882,"url":"https://api.github.com/repos/jbrzusto/motusServer/labels/question","name":"question","color":"cc317c","default":true}],"state":"closed","locked":false,"assignee":{"login":"jbrzusto","id":1228504,"avatar_url":"https://avatars2.githubusercontent.com/u/1228504?v=4","gravatar_id":"","url":"https://api.github.com/users/jbrzusto","html_url":"https://github.com/jbrzusto","followers_url":"https://api.github.com/users/jbrzusto/followers","following_url":"https://api.github.com/users/jbrzusto/following{/other_user}","gists_url":"https://api.github.com/users/jbrzusto/gists{/gist_id}","starred_url":"https://api.github.com/users/jbrzusto/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jbrzusto/subscriptions","organizations_url":"https://api.github.com/users/jbrzusto/orgs","repos_url":"https://api.github.com/users/jbrzusto/repos","events_url":"https://api.github.com/users/jbrzusto/events{/privacy}","received_events_url":"https://api.github.com/users/jbrzusto/received_events","type":"User","site_admin":false},"assignees":[{"login":"jbrzusto","id":1228504,"avatar_url":"https://avatars2.githubusercontent.com/u/1228504?v=4","gravatar_id":"","url":"https://api.github.com/users/jbrzusto","html_url":"https://github.com/jbrzusto","followers_url":"https://api.github.com/users/jbrzusto/followers","following_url":"https://api.github.com/users/jbrzusto/following{/other_user}","gists_url":"https://api.github.com/users/jbrzusto/gists{/gist_id}","starred_url":"https://api.github.com/users/jbrzusto/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jbrzusto/subscriptions","organizations_url":"https://api.github.com/users/jbrzusto/orgs","repos_url":"https://api.github.com/users/jbrzusto/repos","events_url":"https://api.github.com/users/jbrzusto/events{/privacy}","received_events_url":"https://api.github.com/users/jbrzusto/received_events","type":"User","site_admin":false}],"milestone":null,"comments":0,"created_at":"2017-01-04T15:37:05Z","updated_at":"2018-02-23T20:30:02Z","closed_at":"2018-02-23T20:30:02Z","author_association":"OWNER","body":"Is this feasible?  Does it make sense?  The risk is that one badly-behaved job can clog all processing queues. "},"comment":{"url":"https://api.github.com/repos/jbrzusto/motusServer/issues/comments/368130035","html_url":"https://github.com/jbrzusto/motusServer/issues/77#issuecomment-368130035","issue_url":"https://api.github.com/repos/jbrzusto/motusServer/issues/77","id":368130035,"user":{"login":"jbrzusto","id":1228504,"avatar_url":"https://avatars2.githubusercontent.com/u/1228504?v=4","gravatar_id":"","url":"https://api.github.com/users/jbrzusto","html_url":"https://github.com/jbrzusto","followers_url":"https://api.github.com/users/jbrzusto/followers","following_url":"https://api.github.com/users/jbrzusto/following{/other_user}","gists_url":"https://api.github.com/users/jbrzusto/gists{/gist_id}","starred_url":"https://api.github.com/users/jbrzusto/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jbrzusto/subscriptions","organizations_url":"https://api.github.com/users/jbrzusto/orgs","repos_url":"https://api.github.com/users/jbrzusto/repos","events_url":"https://api.github.com/users/jbrzusto/events{/privacy}","received_events_url":"https://api.github.com/users/jbrzusto/received_events","type":"User","site_admin":false},"created_at":"2018-02-23T20:30:02Z","updated_at":"2018-02-23T20:30:02Z","author_association":"OWNER","body":"The tag-finder jobs consume the highest share of CPU among all other types.  So if we can't parallelize\r\nthose, the whole thing isn't worth doing. \r\nBut parallelizing the tag-finder, say by assigning different boot sessions to different CPUs, still requires\r\ncoordination among them for assigning hitIDs and runIDs, e.g. via a table of maxKeys as we do when\r\ntransferring hits and runs to the master motus DB (and even there, we had to disallow parallelism\r\nto prevent issues on the client side caused by infortuitously timed data API queries).  However, we\r\ndon't know in advance how many records needed so would have to reserve keys that ultimately were\r\nnot used, and this would also break the batchwise translation between receiver-DB run and hit IDs, \r\nand those in the master DB.\r\n\r\nSo no.\r\n"}}
{"actor":{"display_login":"jbrzusto"}}