{"action":"closed","number":869,"pull_request":{"url":"https://api.github.com/repos/bigartm/bigartm/pulls/869","id":169613024,"html_url":"https://github.com/bigartm/bigartm/pull/869","diff_url":"https://github.com/bigartm/bigartm/pull/869.diff","patch_url":"https://github.com/bigartm/bigartm/pull/869.patch","issue_url":"https://api.github.com/repos/bigartm/bigartm/issues/869","number":869,"state":"closed","locked":false,"title":"Moving co-occurrence collector in core","user":{"login":"MichaelSolotky","id":25284863,"avatar_url":"https://avatars0.githubusercontent.com/u/25284863?v=4","gravatar_id":"","url":"https://api.github.com/users/MichaelSolotky","html_url":"https://github.com/MichaelSolotky","followers_url":"https://api.github.com/users/MichaelSolotky/followers","following_url":"https://api.github.com/users/MichaelSolotky/following{/other_user}","gists_url":"https://api.github.com/users/MichaelSolotky/gists{/gist_id}","starred_url":"https://api.github.com/users/MichaelSolotky/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MichaelSolotky/subscriptions","organizations_url":"https://api.github.com/users/MichaelSolotky/orgs","repos_url":"https://api.github.com/users/MichaelSolotky/repos","events_url":"https://api.github.com/users/MichaelSolotky/events{/privacy}","received_events_url":"https://api.github.com/users/MichaelSolotky/received_events","type":"User","site_admin":false},"body":"1. CoccurrenceCollector object is created in CollectionParser::ParseVowpalWabbit method.\r\n2. During collection parsing it collects co-occurrences for all portions of documents, dumps it in target folder which is spessified in collection parser config in form of co-occurrence batches (not BigARTM batches)\r\n3. Agregation of co-occurrence batches starts right after parsing and is called in the end of CollectionParser::ParseVowpalWabbit method.","created_at":"2018-02-16T12:30:18Z","updated_at":"2018-03-07T18:00:39Z","closed_at":"2018-03-07T18:00:39Z","merged_at":null,"merge_commit_sha":"155dc1d10085d10731d425f782fbf3465d151e1a","assignee":null,"assignees":[],"requested_reviewers":[{"login":"JeanPaulShapo","id":7376288,"avatar_url":"https://avatars0.githubusercontent.com/u/7376288?v=4","gravatar_id":"","url":"https://api.github.com/users/JeanPaulShapo","html_url":"https://github.com/JeanPaulShapo","followers_url":"https://api.github.com/users/JeanPaulShapo/followers","following_url":"https://api.github.com/users/JeanPaulShapo/following{/other_user}","gists_url":"https://api.github.com/users/JeanPaulShapo/gists{/gist_id}","starred_url":"https://api.github.com/users/JeanPaulShapo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JeanPaulShapo/subscriptions","organizations_url":"https://api.github.com/users/JeanPaulShapo/orgs","repos_url":"https://api.github.com/users/JeanPaulShapo/repos","events_url":"https://api.github.com/users/JeanPaulShapo/events{/privacy}","received_events_url":"https://api.github.com/users/JeanPaulShapo/received_events","type":"User","site_admin":false}],"requested_teams":[],"labels":[],"milestone":null,"commits_url":"https://api.github.com/repos/bigartm/bigartm/pulls/869/commits","review_comments_url":"https://api.github.com/repos/bigartm/bigartm/pulls/869/comments","review_comment_url":"https://api.github.com/repos/bigartm/bigartm/pulls/comments{/number}","comments_url":"https://api.github.com/repos/bigartm/bigartm/issues/869/comments","statuses_url":"https://api.github.com/repos/bigartm/bigartm/statuses/8b83e3efe1ca5ca4da6f51859e27f8fa7c0688ef","head":{"label":"MichaelSolotky:add_cooc_dictionary","ref":"add_cooc_dictionary","sha":"8b83e3efe1ca5ca4da6f51859e27f8fa7c0688ef","user":{"login":"MichaelSolotky","id":25284863,"avatar_url":"https://avatars0.githubusercontent.com/u/25284863?v=4","gravatar_id":"","url":"https://api.github.com/users/MichaelSolotky","html_url":"https://github.com/MichaelSolotky","followers_url":"https://api.github.com/users/MichaelSolotky/followers","following_url":"https://api.github.com/users/MichaelSolotky/following{/other_user}","gists_url":"https://api.github.com/users/MichaelSolotky/gists{/gist_id}","starred_url":"https://api.github.com/users/MichaelSolotky/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MichaelSolotky/subscriptions","organizations_url":"https://api.github.com/users/MichaelSolotky/orgs","repos_url":"https://api.github.com/users/MichaelSolotky/repos","events_url":"https://api.github.com/users/MichaelSolotky/events{/privacy}","received_events_url":"https://api.github.com/users/MichaelSolotky/received_events","type":"User","site_admin":false},"repo":{"id":79933372,"name":"bigartm","full_name":"MichaelSolotky/bigartm","owner":{"login":"MichaelSolotky","id":25284863,"avatar_url":"https://avatars0.githubusercontent.com/u/25284863?v=4","gravatar_id":"","url":"https://api.github.com/users/MichaelSolotky","html_url":"https://github.com/MichaelSolotky","followers_url":"https://api.github.com/users/MichaelSolotky/followers","following_url":"https://api.github.com/users/MichaelSolotky/following{/other_user}","gists_url":"https://api.github.com/users/MichaelSolotky/gists{/gist_id}","starred_url":"https://api.github.com/users/MichaelSolotky/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MichaelSolotky/subscriptions","organizations_url":"https://api.github.com/users/MichaelSolotky/orgs","repos_url":"https://api.github.com/users/MichaelSolotky/repos","events_url":"https://api.github.com/users/MichaelSolotky/events{/privacy}","received_events_url":"https://api.github.com/users/MichaelSolotky/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/MichaelSolotky/bigartm","description":"Fast topic modeling platform","fork":true,"url":"https://api.github.com/repos/MichaelSolotky/bigartm","forks_url":"https://api.github.com/repos/MichaelSolotky/bigartm/forks","keys_url":"https://api.github.com/repos/MichaelSolotky/bigartm/keys{/key_id}","collaborators_url":"https://api.github.com/repos/MichaelSolotky/bigartm/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/MichaelSolotky/bigartm/teams","hooks_url":"https://api.github.com/repos/MichaelSolotky/bigartm/hooks","issue_events_url":"https://api.github.com/repos/MichaelSolotky/bigartm/issues/events{/number}","events_url":"https://api.github.com/repos/MichaelSolotky/bigartm/events","assignees_url":"https://api.github.com/repos/MichaelSolotky/bigartm/assignees{/user}","branches_url":"https://api.github.com/repos/MichaelSolotky/bigartm/branches{/branch}","tags_url":"https://api.github.com/repos/MichaelSolotky/bigartm/tags","blobs_url":"https://api.github.com/repos/MichaelSolotky/bigartm/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/MichaelSolotky/bigartm/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/MichaelSolotky/bigartm/git/refs{/sha}","trees_url":"https://api.github.com/repos/MichaelSolotky/bigartm/git/trees{/sha}","statuses_url":"https://api.github.com/repos/MichaelSolotky/bigartm/statuses/{sha}","languages_url":"https://api.github.com/repos/MichaelSolotky/bigartm/languages","stargazers_url":"https://api.github.com/repos/MichaelSolotky/bigartm/stargazers","contributors_url":"https://api.github.com/repos/MichaelSolotky/bigartm/contributors","subscribers_url":"https://api.github.com/repos/MichaelSolotky/bigartm/subscribers","subscription_url":"https://api.github.com/repos/MichaelSolotky/bigartm/subscription","commits_url":"https://api.github.com/repos/MichaelSolotky/bigartm/commits{/sha}","git_commits_url":"https://api.github.com/repos/MichaelSolotky/bigartm/git/commits{/sha}","comments_url":"https://api.github.com/repos/MichaelSolotky/bigartm/comments{/number}","issue_comment_url":"https://api.github.com/repos/MichaelSolotky/bigartm/issues/comments{/number}","contents_url":"https://api.github.com/repos/MichaelSolotky/bigartm/contents/{+path}","compare_url":"https://api.github.com/repos/MichaelSolotky/bigartm/compare/{base}...{head}","merges_url":"https://api.github.com/repos/MichaelSolotky/bigartm/merges","archive_url":"https://api.github.com/repos/MichaelSolotky/bigartm/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/MichaelSolotky/bigartm/downloads","issues_url":"https://api.github.com/repos/MichaelSolotky/bigartm/issues{/number}","pulls_url":"https://api.github.com/repos/MichaelSolotky/bigartm/pulls{/number}","milestones_url":"https://api.github.com/repos/MichaelSolotky/bigartm/milestones{/number}","notifications_url":"https://api.github.com/repos/MichaelSolotky/bigartm/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/MichaelSolotky/bigartm/labels{/name}","releases_url":"https://api.github.com/repos/MichaelSolotky/bigartm/releases{/id}","deployments_url":"https://api.github.com/repos/MichaelSolotky/bigartm/deployments","created_at":"2017-01-24T17:05:14Z","updated_at":"2017-01-27T12:04:28Z","pushed_at":"2018-03-06T15:24:21Z","git_url":"git://github.com/MichaelSolotky/bigartm.git","ssh_url":"git@github.com:MichaelSolotky/bigartm.git","clone_url":"https://github.com/MichaelSolotky/bigartm.git","svn_url":"https://github.com/MichaelSolotky/bigartm","homepage":"http://bigartm.org/","size":17246,"stargazers_count":0,"watchers_count":0,"language":"C++","has_issues":false,"has_projects":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"archived":false,"open_issues_count":1,"license":{"key":"other","name":"Other","spdx_id":null,"url":null},"forks":0,"open_issues":1,"watchers":0,"default_branch":"add_cooc_dictionary"}},"base":{"label":"bigartm:master","ref":"master","sha":"519a0479ba00becfed762a03c82a09e171423de2","user":{"login":"bigartm","id":8783740,"avatar_url":"https://avatars0.githubusercontent.com/u/8783740?v=4","gravatar_id":"","url":"https://api.github.com/users/bigartm","html_url":"https://github.com/bigartm","followers_url":"https://api.github.com/users/bigartm/followers","following_url":"https://api.github.com/users/bigartm/following{/other_user}","gists_url":"https://api.github.com/users/bigartm/gists{/gist_id}","starred_url":"https://api.github.com/users/bigartm/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bigartm/subscriptions","organizations_url":"https://api.github.com/users/bigartm/orgs","repos_url":"https://api.github.com/users/bigartm/repos","events_url":"https://api.github.com/users/bigartm/events{/privacy}","received_events_url":"https://api.github.com/users/bigartm/received_events","type":"Organization","site_admin":false},"repo":{"id":24072579,"name":"bigartm","full_name":"bigartm/bigartm","owner":{"login":"bigartm","id":8783740,"avatar_url":"https://avatars0.githubusercontent.com/u/8783740?v=4","gravatar_id":"","url":"https://api.github.com/users/bigartm","html_url":"https://github.com/bigartm","followers_url":"https://api.github.com/users/bigartm/followers","following_url":"https://api.github.com/users/bigartm/following{/other_user}","gists_url":"https://api.github.com/users/bigartm/gists{/gist_id}","starred_url":"https://api.github.com/users/bigartm/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bigartm/subscriptions","organizations_url":"https://api.github.com/users/bigartm/orgs","repos_url":"https://api.github.com/users/bigartm/repos","events_url":"https://api.github.com/users/bigartm/events{/privacy}","received_events_url":"https://api.github.com/users/bigartm/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/bigartm/bigartm","description":"Fast topic modeling platform","fork":false,"url":"https://api.github.com/repos/bigartm/bigartm","forks_url":"https://api.github.com/repos/bigartm/bigartm/forks","keys_url":"https://api.github.com/repos/bigartm/bigartm/keys{/key_id}","collaborators_url":"https://api.github.com/repos/bigartm/bigartm/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/bigartm/bigartm/teams","hooks_url":"https://api.github.com/repos/bigartm/bigartm/hooks","issue_events_url":"https://api.github.com/repos/bigartm/bigartm/issues/events{/number}","events_url":"https://api.github.com/repos/bigartm/bigartm/events","assignees_url":"https://api.github.com/repos/bigartm/bigartm/assignees{/user}","branches_url":"https://api.github.com/repos/bigartm/bigartm/branches{/branch}","tags_url":"https://api.github.com/repos/bigartm/bigartm/tags","blobs_url":"https://api.github.com/repos/bigartm/bigartm/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/bigartm/bigartm/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/bigartm/bigartm/git/refs{/sha}","trees_url":"https://api.github.com/repos/bigartm/bigartm/git/trees{/sha}","statuses_url":"https://api.github.com/repos/bigartm/bigartm/statuses/{sha}","languages_url":"https://api.github.com/repos/bigartm/bigartm/languages","stargazers_url":"https://api.github.com/repos/bigartm/bigartm/stargazers","contributors_url":"https://api.github.com/repos/bigartm/bigartm/contributors","subscribers_url":"https://api.github.com/repos/bigartm/bigartm/subscribers","subscription_url":"https://api.github.com/repos/bigartm/bigartm/subscription","commits_url":"https://api.github.com/repos/bigartm/bigartm/commits{/sha}","git_commits_url":"https://api.github.com/repos/bigartm/bigartm/git/commits{/sha}","comments_url":"https://api.github.com/repos/bigartm/bigartm/comments{/number}","issue_comment_url":"https://api.github.com/repos/bigartm/bigartm/issues/comments{/number}","contents_url":"https://api.github.com/repos/bigartm/bigartm/contents/{+path}","compare_url":"https://api.github.com/repos/bigartm/bigartm/compare/{base}...{head}","merges_url":"https://api.github.com/repos/bigartm/bigartm/merges","archive_url":"https://api.github.com/repos/bigartm/bigartm/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/bigartm/bigartm/downloads","issues_url":"https://api.github.com/repos/bigartm/bigartm/issues{/number}","pulls_url":"https://api.github.com/repos/bigartm/bigartm/pulls{/number}","milestones_url":"https://api.github.com/repos/bigartm/bigartm/milestones{/number}","notifications_url":"https://api.github.com/repos/bigartm/bigartm/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/bigartm/bigartm/labels{/name}","releases_url":"https://api.github.com/repos/bigartm/bigartm/releases{/id}","deployments_url":"https://api.github.com/repos/bigartm/bigartm/deployments","created_at":"2014-09-15T20:26:11Z","updated_at":"2018-03-04T23:24:23Z","pushed_at":"2018-03-06T23:53:02Z","git_url":"git://github.com/bigartm/bigartm.git","ssh_url":"git@github.com:bigartm/bigartm.git","clone_url":"https://github.com/bigartm/bigartm.git","svn_url":"https://github.com/bigartm/bigartm","homepage":"http://bigartm.org/","size":17031,"stargazers_count":255,"watchers_count":255,"language":"C++","has_issues":true,"has_projects":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":72,"mirror_url":null,"archived":false,"open_issues_count":104,"license":{"key":"other","name":"Other","spdx_id":null,"url":null},"forks":72,"open_issues":104,"watchers":255,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/bigartm/bigartm/pulls/869"},"html":{"href":"https://github.com/bigartm/bigartm/pull/869"},"issue":{"href":"https://api.github.com/repos/bigartm/bigartm/issues/869"},"comments":{"href":"https://api.github.com/repos/bigartm/bigartm/issues/869/comments"},"review_comments":{"href":"https://api.github.com/repos/bigartm/bigartm/pulls/869/comments"},"review_comment":{"href":"https://api.github.com/repos/bigartm/bigartm/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/bigartm/bigartm/pulls/869/commits"},"statuses":{"href":"https://api.github.com/repos/bigartm/bigartm/statuses/8b83e3efe1ca5ca4da6f51859e27f8fa7c0688ef"}},"author_association":"CONTRIBUTOR","merged":false,"mergeable":true,"rebaseable":false,"mergeable_state":"unstable","merged_by":null,"comments":0,"review_comments":19,"maintainer_can_modify":false,"commits":59,"additions":1476,"deletions":1002,"changed_files":14}}
{"actor":{"display_login":"MichaelSolotky"}}