{"action":"created","comment":{"url":"https://api.github.com/repos/dselivanov/text2vec/pulls/comments/57344365","id":57344365,"diff_hunk":"@@ -0,0 +1,44 @@\n+[![CRAN_Status_Badge](http://www.r-pkg.org/badges/version/text2vec)](http://cran.r-project.org/package=text2vec)\n+[![Travis-CI Build Status](https://travis-ci.org/dselivanov/text2vec.svg?branch=master)](https://travis-ci.org/dselivanov/text2vec)\n+[![License](http://img.shields.io/:license-mit-blue.svg?style=flat)](http://badges.mit-license.org)\n+[![Downloads](http://cranlogs.r-pkg.org/badges/grand-total/text2vec)](http://cran.rstudio.com/package=text2vec)\n+[![Follow](https://img.shields.io/twitter/follow/dselvan0v.svg?style=social)](https://twitter.com/intent/follow?screen_name=dselvan0v)\n+\n+# Tutorials\n+\n+1. [Vectorization](http://dsnotes.com/blog/text2vec/2015/11/09/text2vec/).\n+2. [GloVe on English Wikipedia](http://dsnotes.com/blog/text2vec/2015/12/01/glove-enwiki/).\n+\n+# Features\n+\n+**text2vec** is a package that provides an efficient framework with a concise API for text analysis and natural language processing (NLP) in R. It is inspired by [gensim](http://radimrehurek.com/gensim/), an excellent Python library for NLP.\n+\n+The core functionality at the moment includes\n+\n+1. Fast text vectorization on arbitrary n-grams, using vocabulary or feature hashing.\n+2. State-of-the-art [GloVe](http://www-nlp.stanford.edu/projects/glove/) word embeddings.\n+\n+## Efficiency  \n+\n+The core of this package is carefully written in C++, which means text2vec is fast and memory friendly. Some parts (GloVe training) are fully parallelized using the excellent [RcppParallel](http://rcppcore.github.io/RcppParallel/) package. This means that parallel processing works on OS X, Linux, Windows and Solaris (x86) without any additional hacking or tricks. In addition, there is a higher-level parallelization for text vectorization and vocabulary construction on top of the [foreach](https://cran.r-project.org/package=foreach) package, and text2vec has a streaming API so that users don't have to load all of the data into RAM.\n+\n+## API\n+\n+The API is built around the [iterator](https://en.wikipedia.org/wiki/Iterator) abstraction. The API is concise, providing only a few functions which do their job well. The package does not (and probably will not in the future) provide trivial very high-level functions. But other packages can build on top of the framework that text2vec provides.\n+\n+## Terminology ","path":"README.md","position":29,"original_position":29,"commit_id":"80156789bc1a7935ec9451b2e6fa1bf6c99ffe79","original_commit_id":"80156789bc1a7935ec9451b2e6fa1bf6c99ffe79","user":{"login":"dselivanov","id":5123805,"avatar_url":"https://avatars.githubusercontent.com/u/5123805?v=3","gravatar_id":"","url":"https://api.github.com/users/dselivanov","html_url":"https://github.com/dselivanov","followers_url":"https://api.github.com/users/dselivanov/followers","following_url":"https://api.github.com/users/dselivanov/following{/other_user}","gists_url":"https://api.github.com/users/dselivanov/gists{/gist_id}","starred_url":"https://api.github.com/users/dselivanov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dselivanov/subscriptions","organizations_url":"https://api.github.com/users/dselivanov/orgs","repos_url":"https://api.github.com/users/dselivanov/repos","events_url":"https://api.github.com/users/dselivanov/events{/privacy}","received_events_url":"https://api.github.com/users/dselivanov/received_events","type":"User","site_admin":false},"body":"can delete whole section,  I copied all the gory technical details to [wiki](https://github.com/dselivanov/text2vec/wiki)","created_at":"2016-03-24T16:26:42Z","updated_at":"2016-03-24T16:26:42Z","html_url":"https://github.com/dselivanov/text2vec/pull/82#discussion_r57344365","pull_request_url":"https://api.github.com/repos/dselivanov/text2vec/pulls/82","_links":{"self":{"href":"https://api.github.com/repos/dselivanov/text2vec/pulls/comments/57344365"},"html":{"href":"https://github.com/dselivanov/text2vec/pull/82#discussion_r57344365"},"pull_request":{"href":"https://api.github.com/repos/dselivanov/text2vec/pulls/82"}}},"pull_request":{"url":"https://api.github.com/repos/dselivanov/text2vec/pulls/82","id":64041589,"html_url":"https://github.com/dselivanov/text2vec/pull/82","diff_url":"https://github.com/dselivanov/text2vec/pull/82.diff","patch_url":"https://github.com/dselivanov/text2vec/pull/82.patch","issue_url":"https://api.github.com/repos/dselivanov/text2vec/issues/82","number":82,"state":"open","locked":false,"title":"Revise README","user":{"login":"lmullen","id":183672,"avatar_url":"https://avatars.githubusercontent.com/u/183672?v=3","gravatar_id":"","url":"https://api.github.com/users/lmullen","html_url":"https://github.com/lmullen","followers_url":"https://api.github.com/users/lmullen/followers","following_url":"https://api.github.com/users/lmullen/following{/other_user}","gists_url":"https://api.github.com/users/lmullen/gists{/gist_id}","starred_url":"https://api.github.com/users/lmullen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lmullen/subscriptions","organizations_url":"https://api.github.com/users/lmullen/orgs","repos_url":"https://api.github.com/users/lmullen/repos","events_url":"https://api.github.com/users/lmullen/events{/privacy}","received_events_url":"https://api.github.com/users/lmullen/received_events","type":"User","site_admin":false},"body":"@dselivanov This is a revision of the README along the lines of what I did for the vignettes.\r\n\r\nSome suggestions:\r\n\r\n- Should the links to the tutorials be replace with links to or instructions on how to get to the vignettes? Seems like the vignettes are less likely to be out of date.\r\n- You have a discussion of the Corpus object under \"Terminology.\" I think you could cut the whole terminology section since it is out of date for 0.3 and since it's too much information for a README.\r\n\r\nGoing to work on function level documentation next.","created_at":"2016-03-24T14:30:06Z","updated_at":"2016-03-24T16:26:42Z","closed_at":null,"merged_at":null,"merge_commit_sha":"5c0f7d7544d40d7e8d216c69918c432107bbc270","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/dselivanov/text2vec/pulls/82/commits","review_comments_url":"https://api.github.com/repos/dselivanov/text2vec/pulls/82/comments","review_comment_url":"https://api.github.com/repos/dselivanov/text2vec/pulls/comments{/number}","comments_url":"https://api.github.com/repos/dselivanov/text2vec/issues/82/comments","statuses_url":"https://api.github.com/repos/dselivanov/text2vec/statuses/80156789bc1a7935ec9451b2e6fa1bf6c99ffe79","head":{"label":"lmullen:revise-readme","ref":"revise-readme","sha":"80156789bc1a7935ec9451b2e6fa1bf6c99ffe79","user":{"login":"lmullen","id":183672,"avatar_url":"https://avatars.githubusercontent.com/u/183672?v=3","gravatar_id":"","url":"https://api.github.com/users/lmullen","html_url":"https://github.com/lmullen","followers_url":"https://api.github.com/users/lmullen/followers","following_url":"https://api.github.com/users/lmullen/following{/other_user}","gists_url":"https://api.github.com/users/lmullen/gists{/gist_id}","starred_url":"https://api.github.com/users/lmullen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lmullen/subscriptions","organizations_url":"https://api.github.com/users/lmullen/orgs","repos_url":"https://api.github.com/users/lmullen/repos","events_url":"https://api.github.com/users/lmullen/events{/privacy}","received_events_url":"https://api.github.com/users/lmullen/received_events","type":"User","site_admin":false},"repo":{"id":53589510,"name":"text2vec","full_name":"lmullen/text2vec","owner":{"login":"lmullen","id":183672,"avatar_url":"https://avatars.githubusercontent.com/u/183672?v=3","gravatar_id":"","url":"https://api.github.com/users/lmullen","html_url":"https://github.com/lmullen","followers_url":"https://api.github.com/users/lmullen/followers","following_url":"https://api.github.com/users/lmullen/following{/other_user}","gists_url":"https://api.github.com/users/lmullen/gists{/gist_id}","starred_url":"https://api.github.com/users/lmullen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lmullen/subscriptions","organizations_url":"https://api.github.com/users/lmullen/orgs","repos_url":"https://api.github.com/users/lmullen/repos","events_url":"https://api.github.com/users/lmullen/events{/privacy}","received_events_url":"https://api.github.com/users/lmullen/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/lmullen/text2vec","description":"Fast text mining framework for R. Text vectorization and state-of-the-art GloVe word embeddings.","fork":true,"url":"https://api.github.com/repos/lmullen/text2vec","forks_url":"https://api.github.com/repos/lmullen/text2vec/forks","keys_url":"https://api.github.com/repos/lmullen/text2vec/keys{/key_id}","collaborators_url":"https://api.github.com/repos/lmullen/text2vec/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/lmullen/text2vec/teams","hooks_url":"https://api.github.com/repos/lmullen/text2vec/hooks","issue_events_url":"https://api.github.com/repos/lmullen/text2vec/issues/events{/number}","events_url":"https://api.github.com/repos/lmullen/text2vec/events","assignees_url":"https://api.github.com/repos/lmullen/text2vec/assignees{/user}","branches_url":"https://api.github.com/repos/lmullen/text2vec/branches{/branch}","tags_url":"https://api.github.com/repos/lmullen/text2vec/tags","blobs_url":"https://api.github.com/repos/lmullen/text2vec/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/lmullen/text2vec/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/lmullen/text2vec/git/refs{/sha}","trees_url":"https://api.github.com/repos/lmullen/text2vec/git/trees{/sha}","statuses_url":"https://api.github.com/repos/lmullen/text2vec/statuses/{sha}","languages_url":"https://api.github.com/repos/lmullen/text2vec/languages","stargazers_url":"https://api.github.com/repos/lmullen/text2vec/stargazers","contributors_url":"https://api.github.com/repos/lmullen/text2vec/contributors","subscribers_url":"https://api.github.com/repos/lmullen/text2vec/subscribers","subscription_url":"https://api.github.com/repos/lmullen/text2vec/subscription","commits_url":"https://api.github.com/repos/lmullen/text2vec/commits{/sha}","git_commits_url":"https://api.github.com/repos/lmullen/text2vec/git/commits{/sha}","comments_url":"https://api.github.com/repos/lmullen/text2vec/comments{/number}","issue_comment_url":"https://api.github.com/repos/lmullen/text2vec/issues/comments{/number}","contents_url":"https://api.github.com/repos/lmullen/text2vec/contents/{+path}","compare_url":"https://api.github.com/repos/lmullen/text2vec/compare/{base}...{head}","merges_url":"https://api.github.com/repos/lmullen/text2vec/merges","archive_url":"https://api.github.com/repos/lmullen/text2vec/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/lmullen/text2vec/downloads","issues_url":"https://api.github.com/repos/lmullen/text2vec/issues{/number}","pulls_url":"https://api.github.com/repos/lmullen/text2vec/pulls{/number}","milestones_url":"https://api.github.com/repos/lmullen/text2vec/milestones{/number}","notifications_url":"https://api.github.com/repos/lmullen/text2vec/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/lmullen/text2vec/labels{/name}","releases_url":"https://api.github.com/repos/lmullen/text2vec/releases{/id}","deployments_url":"https://api.github.com/repos/lmullen/text2vec/deployments","created_at":"2016-03-10T14:10:48Z","updated_at":"2016-03-10T14:10:49Z","pushed_at":"2016-03-24T14:48:14Z","git_url":"git://github.com/lmullen/text2vec.git","ssh_url":"git@github.com:lmullen/text2vec.git","clone_url":"https://github.com/lmullen/text2vec.git","svn_url":"https://github.com/lmullen/text2vec","homepage":"http://dsnotes.com/","size":39998,"stargazers_count":0,"watchers_count":0,"language":"R","has_issues":false,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"master"}},"base":{"label":"dselivanov:0.3","ref":"0.3","sha":"c36f030a25d0f6350d3397332c5e921d1c5a5e28","user":{"login":"dselivanov","id":5123805,"avatar_url":"https://avatars.githubusercontent.com/u/5123805?v=3","gravatar_id":"","url":"https://api.github.com/users/dselivanov","html_url":"https://github.com/dselivanov","followers_url":"https://api.github.com/users/dselivanov/followers","following_url":"https://api.github.com/users/dselivanov/following{/other_user}","gists_url":"https://api.github.com/users/dselivanov/gists{/gist_id}","starred_url":"https://api.github.com/users/dselivanov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dselivanov/subscriptions","organizations_url":"https://api.github.com/users/dselivanov/orgs","repos_url":"https://api.github.com/users/dselivanov/repos","events_url":"https://api.github.com/users/dselivanov/events{/privacy}","received_events_url":"https://api.github.com/users/dselivanov/received_events","type":"User","site_admin":false},"repo":{"id":40227854,"name":"text2vec","full_name":"dselivanov/text2vec","owner":{"login":"dselivanov","id":5123805,"avatar_url":"https://avatars.githubusercontent.com/u/5123805?v=3","gravatar_id":"","url":"https://api.github.com/users/dselivanov","html_url":"https://github.com/dselivanov","followers_url":"https://api.github.com/users/dselivanov/followers","following_url":"https://api.github.com/users/dselivanov/following{/other_user}","gists_url":"https://api.github.com/users/dselivanov/gists{/gist_id}","starred_url":"https://api.github.com/users/dselivanov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dselivanov/subscriptions","organizations_url":"https://api.github.com/users/dselivanov/orgs","repos_url":"https://api.github.com/users/dselivanov/repos","events_url":"https://api.github.com/users/dselivanov/events{/privacy}","received_events_url":"https://api.github.com/users/dselivanov/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/dselivanov/text2vec","description":"Fast text mining framework for R. Text vectorization and state-of-the-art GloVe word embeddings.","fork":false,"url":"https://api.github.com/repos/dselivanov/text2vec","forks_url":"https://api.github.com/repos/dselivanov/text2vec/forks","keys_url":"https://api.github.com/repos/dselivanov/text2vec/keys{/key_id}","collaborators_url":"https://api.github.com/repos/dselivanov/text2vec/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/dselivanov/text2vec/teams","hooks_url":"https://api.github.com/repos/dselivanov/text2vec/hooks","issue_events_url":"https://api.github.com/repos/dselivanov/text2vec/issues/events{/number}","events_url":"https://api.github.com/repos/dselivanov/text2vec/events","assignees_url":"https://api.github.com/repos/dselivanov/text2vec/assignees{/user}","branches_url":"https://api.github.com/repos/dselivanov/text2vec/branches{/branch}","tags_url":"https://api.github.com/repos/dselivanov/text2vec/tags","blobs_url":"https://api.github.com/repos/dselivanov/text2vec/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/dselivanov/text2vec/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/dselivanov/text2vec/git/refs{/sha}","trees_url":"https://api.github.com/repos/dselivanov/text2vec/git/trees{/sha}","statuses_url":"https://api.github.com/repos/dselivanov/text2vec/statuses/{sha}","languages_url":"https://api.github.com/repos/dselivanov/text2vec/languages","stargazers_url":"https://api.github.com/repos/dselivanov/text2vec/stargazers","contributors_url":"https://api.github.com/repos/dselivanov/text2vec/contributors","subscribers_url":"https://api.github.com/repos/dselivanov/text2vec/subscribers","subscription_url":"https://api.github.com/repos/dselivanov/text2vec/subscription","commits_url":"https://api.github.com/repos/dselivanov/text2vec/commits{/sha}","git_commits_url":"https://api.github.com/repos/dselivanov/text2vec/git/commits{/sha}","comments_url":"https://api.github.com/repos/dselivanov/text2vec/comments{/number}","issue_comment_url":"https://api.github.com/repos/dselivanov/text2vec/issues/comments{/number}","contents_url":"https://api.github.com/repos/dselivanov/text2vec/contents/{+path}","compare_url":"https://api.github.com/repos/dselivanov/text2vec/compare/{base}...{head}","merges_url":"https://api.github.com/repos/dselivanov/text2vec/merges","archive_url":"https://api.github.com/repos/dselivanov/text2vec/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/dselivanov/text2vec/downloads","issues_url":"https://api.github.com/repos/dselivanov/text2vec/issues{/number}","pulls_url":"https://api.github.com/repos/dselivanov/text2vec/pulls{/number}","milestones_url":"https://api.github.com/repos/dselivanov/text2vec/milestones{/number}","notifications_url":"https://api.github.com/repos/dselivanov/text2vec/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/dselivanov/text2vec/labels{/name}","releases_url":"https://api.github.com/repos/dselivanov/text2vec/releases{/id}","deployments_url":"https://api.github.com/repos/dselivanov/text2vec/deployments","created_at":"2015-08-05T06:09:14Z","updated_at":"2016-03-24T14:16:50Z","pushed_at":"2016-03-24T14:49:24Z","git_url":"git://github.com/dselivanov/text2vec.git","ssh_url":"git@github.com:dselivanov/text2vec.git","clone_url":"https://github.com/dselivanov/text2vec.git","svn_url":"https://github.com/dselivanov/text2vec","homepage":"http://dsnotes.com/","size":39984,"stargazers_count":73,"watchers_count":73,"language":"R","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":16,"mirror_url":null,"open_issues_count":27,"forks":16,"open_issues":27,"watchers":73,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/dselivanov/text2vec/pulls/82"},"html":{"href":"https://github.com/dselivanov/text2vec/pull/82"},"issue":{"href":"https://api.github.com/repos/dselivanov/text2vec/issues/82"},"comments":{"href":"https://api.github.com/repos/dselivanov/text2vec/issues/82/comments"},"review_comments":{"href":"https://api.github.com/repos/dselivanov/text2vec/pulls/82/comments"},"review_comment":{"href":"https://api.github.com/repos/dselivanov/text2vec/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/dselivanov/text2vec/pulls/82/commits"},"statuses":{"href":"https://api.github.com/repos/dselivanov/text2vec/statuses/80156789bc1a7935ec9451b2e6fa1bf6c99ffe79"}}}}