{"action":"created","issue":{"url":"https://api.github.com/repos/biolab/orange3-text/issues/43","repository_url":"https://api.github.com/repos/biolab/orange3-text","labels_url":"https://api.github.com/repos/biolab/orange3-text/issues/43/labels{/name}","comments_url":"https://api.github.com/repos/biolab/orange3-text/issues/43/comments","events_url":"https://api.github.com/repos/biolab/orange3-text/issues/43/events","html_url":"https://github.com/biolab/orange3-text/pull/43","id":141759497,"number":43,"title":"[WIP] Preprocess. Another approach.","user":{"login":"s-alexey","id":9372243,"avatar_url":"https://avatars.githubusercontent.com/u/9372243?v=3","gravatar_id":"","url":"https://api.github.com/users/s-alexey","html_url":"https://github.com/s-alexey","followers_url":"https://api.github.com/users/s-alexey/followers","following_url":"https://api.github.com/users/s-alexey/following{/other_user}","gists_url":"https://api.github.com/users/s-alexey/gists{/gist_id}","starred_url":"https://api.github.com/users/s-alexey/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/s-alexey/subscriptions","organizations_url":"https://api.github.com/users/s-alexey/orgs","repos_url":"https://api.github.com/users/s-alexey/repos","events_url":"https://api.github.com/users/s-alexey/events{/privacy}","received_events_url":"https://api.github.com/users/s-alexey/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-03-18T02:49:51Z","updated_at":"2016-03-22T12:49:49Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/biolab/orange3-text/pulls/43","html_url":"https://github.com/biolab/orange3-text/pull/43","diff_url":"https://github.com/biolab/orange3-text/pull/43.diff","patch_url":"https://github.com/biolab/orange3-text/pull/43.patch"},"body":"Here is my suggestion about preprocessing widget. \r\n\r\nThis widget will be used almost everywhere in this add-on and sometimes we will need only one part of its functionality (for example, tokenizer). So I think it would better to split its pipeline into several stages:\r\n- string transformation (lowercase, HTML-parsing)\r\n- tokenization \r\n- token filtering (stop-words, URLs)\r\n- token normalization (stemming, abbreviation, slang) \r\n\r\nIn this PR I provide base classes + some examples for each stage. \r\n"},"comment":{"url":"https://api.github.com/repos/biolab/orange3-text/issues/comments/199796147","html_url":"https://github.com/biolab/orange3-text/pull/43#issuecomment-199796147","issue_url":"https://api.github.com/repos/biolab/orange3-text/issues/43","id":199796147,"user":{"login":"nikicc","id":713026,"avatar_url":"https://avatars.githubusercontent.com/u/713026?v=3","gravatar_id":"","url":"https://api.github.com/users/nikicc","html_url":"https://github.com/nikicc","followers_url":"https://api.github.com/users/nikicc/followers","following_url":"https://api.github.com/users/nikicc/following{/other_user}","gists_url":"https://api.github.com/users/nikicc/gists{/gist_id}","starred_url":"https://api.github.com/users/nikicc/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nikicc/subscriptions","organizations_url":"https://api.github.com/users/nikicc/orgs","repos_url":"https://api.github.com/users/nikicc/repos","events_url":"https://api.github.com/users/nikicc/events{/privacy}","received_events_url":"https://api.github.com/users/nikicc/received_events","type":"User","site_admin":false},"created_at":"2016-03-22T12:49:49Z","updated_at":"2016-03-22T12:49:49Z","body":"Looks great! We were just before merging #21, so I have to check how this conflicts with that."}}