{"action":"created","issue":{"url":"https://api.github.com/repos/berkmancenter/mediacloud/issues/12","repository_url":"https://api.github.com/repos/berkmancenter/mediacloud","labels_url":"https://api.github.com/repos/berkmancenter/mediacloud/issues/12/labels{/name}","comments_url":"https://api.github.com/repos/berkmancenter/mediacloud/issues/12/comments","events_url":"https://api.github.com/repos/berkmancenter/mediacloud/issues/12/events","html_url":"https://github.com/berkmancenter/mediacloud/issues/12","id":155526425,"number":12,"title":"estimate potential throughput for corenlp annotation","user":{"login":"hroberts","id":1830735,"avatar_url":"https://avatars.githubusercontent.com/u/1830735?v=3","gravatar_id":"","url":"https://api.github.com/users/hroberts","html_url":"https://github.com/hroberts","followers_url":"https://api.github.com/users/hroberts/followers","following_url":"https://api.github.com/users/hroberts/following{/other_user}","gists_url":"https://api.github.com/users/hroberts/gists{/gist_id}","starred_url":"https://api.github.com/users/hroberts/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hroberts/subscriptions","organizations_url":"https://api.github.com/users/hroberts/orgs","repos_url":"https://api.github.com/users/hroberts/repos","events_url":"https://api.github.com/users/hroberts/events{/privacy}","received_events_url":"https://api.github.com/users/hroberts/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/berkmancenter/mediacloud/labels/question","name":"question","color":"cc317c"}],"state":"open","locked":false,"assignee":{"login":"pypt","id":181949,"avatar_url":"https://avatars.githubusercontent.com/u/181949?v=3","gravatar_id":"","url":"https://api.github.com/users/pypt","html_url":"https://github.com/pypt","followers_url":"https://api.github.com/users/pypt/followers","following_url":"https://api.github.com/users/pypt/following{/other_user}","gists_url":"https://api.github.com/users/pypt/gists{/gist_id}","starred_url":"https://api.github.com/users/pypt/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pypt/subscriptions","organizations_url":"https://api.github.com/users/pypt/orgs","repos_url":"https://api.github.com/users/pypt/repos","events_url":"https://api.github.com/users/pypt/events{/privacy}","received_events_url":"https://api.github.com/users/pypt/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/berkmancenter/mediacloud/milestones/2","html_url":"https://github.com/berkmancenter/mediacloud/milestones/this%20week","labels_url":"https://api.github.com/repos/berkmancenter/mediacloud/milestones/2/labels","id":1774255,"number":2,"title":"this week","description":"","creator":{"login":"hroberts","id":1830735,"avatar_url":"https://avatars.githubusercontent.com/u/1830735?v=3","gravatar_id":"","url":"https://api.github.com/users/hroberts","html_url":"https://github.com/hroberts","followers_url":"https://api.github.com/users/hroberts/followers","following_url":"https://api.github.com/users/hroberts/following{/other_user}","gists_url":"https://api.github.com/users/hroberts/gists{/gist_id}","starred_url":"https://api.github.com/users/hroberts/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hroberts/subscriptions","organizations_url":"https://api.github.com/users/hroberts/orgs","repos_url":"https://api.github.com/users/hroberts/repos","events_url":"https://api.github.com/users/hroberts/events{/privacy}","received_events_url":"https://api.github.com/users/hroberts/received_events","type":"User","site_admin":false},"open_issues":1,"closed_issues":1,"state":"open","created_at":"2016-05-18T15:09:05Z","updated_at":"2016-05-18T20:00:01Z","due_on":null,"closed_at":null},"comments":5,"created_at":"2016-05-18T15:08:02Z","updated_at":"2016-05-20T16:37:40Z","closed_at":null,"body":"The geotagging is capable of handling about a million stories per day.  It would be great to be able to feed it that many corenlp annotated stories.  It would also be great not to have to have a special flag for which stories we annotate, but instead just to annotate all english language stories.\r\n\r\nCan you please generate an estimate of how many stories the corenlp annotation can handle and if that number is high enough for us to annotate all english language stories?"},"comment":{"url":"https://api.github.com/repos/berkmancenter/mediacloud/issues/comments/220655857","html_url":"https://github.com/berkmancenter/mediacloud/issues/12#issuecomment-220655857","issue_url":"https://api.github.com/repos/berkmancenter/mediacloud/issues/12","id":220655857,"user":{"login":"hroberts","id":1830735,"avatar_url":"https://avatars.githubusercontent.com/u/1830735?v=3","gravatar_id":"","url":"https://api.github.com/users/hroberts","html_url":"https://github.com/hroberts","followers_url":"https://api.github.com/users/hroberts/followers","following_url":"https://api.github.com/users/hroberts/following{/other_user}","gists_url":"https://api.github.com/users/hroberts/gists{/gist_id}","starred_url":"https://api.github.com/users/hroberts/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hroberts/subscriptions","organizations_url":"https://api.github.com/users/hroberts/orgs","repos_url":"https://api.github.com/users/hroberts/repos","events_url":"https://api.github.com/users/hroberts/events{/privacy}","received_events_url":"https://api.github.com/users/hroberts/received_events","type":"User","site_admin":false},"created_at":"2016-05-20T16:37:40Z","updated_at":"2016-05-20T16:37:40Z","body":"Yes, some of the load is on postgres and amazon, and the load on mcnlp \nwill not be totally exclusive with Rahul's work.  So I think we'll get \nbetter than 0.5x from each process.  But it won't be 1x either.\n\nI think we clearly have room for the whole stream of new stories, so it \nwould be safe to turn that one and get a sense for how much slack we end \nup with.  We will probably end up building a queueing daemon as we have \nin the past that just looks for slack in the pipeline and inserts \narchive stories into the queue as there is slack.\n\n\n-hal\n"}}
{"actor":{"display_login":"hroberts"}}