{"action":"created","issue":{"url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/7286","repository_url":"https://api.github.com/repos/scikit-learn/scikit-learn","labels_url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/7286/labels{/name}","comments_url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/7286/comments","events_url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/7286/events","html_url":"https://github.com/scikit-learn/scikit-learn/pull/7286","id":173889053,"number":7286,"title":"Cleaned and updated version of token-processor v2","user":{"login":"rth","id":630936,"avatar_url":"https://avatars.githubusercontent.com/u/630936?v=3","gravatar_id":"","url":"https://api.github.com/users/rth","html_url":"https://github.com/rth","followers_url":"https://api.github.com/users/rth/followers","following_url":"https://api.github.com/users/rth/following{/other_user}","gists_url":"https://api.github.com/users/rth/gists{/gist_id}","starred_url":"https://api.github.com/users/rth/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rth/subscriptions","organizations_url":"https://api.github.com/users/rth/orgs","repos_url":"https://api.github.com/users/rth/repos","events_url":"https://api.github.com/users/rth/events{/privacy}","received_events_url":"https://api.github.com/users/rth/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2016-08-29T22:34:52Z","updated_at":"2016-08-29T22:43:12Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/scikit-learn/scikit-learn/pulls/7286","html_url":"https://github.com/scikit-learn/scikit-learn/pull/7286","diff_url":"https://github.com/scikit-learn/scikit-learn/pull/7286.diff","patch_url":"https://github.com/scikit-learn/scikit-learn/pull/7286.patch"},"body":"Rebased version of PR #1735, fixes Issue #1156.\r\n\r\nThis would allow to plug-in a custom token processor for text feature extraction, which can be used e.g. for stemming.\r\n\r\nThis PR addresses  review comments by @GaelVaroquaux  in the original PR.\r\n\r\nSince this is a relatively demanded feature (cf. comments in the original PR) with the general idea mostly validated in 2013: would it be possible to include this into the 0.18 release? "},"comment":{"url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/comments/243280038","html_url":"https://github.com/scikit-learn/scikit-learn/pull/7286#issuecomment-243280038","issue_url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/7286","id":243280038,"user":{"login":"amueller","id":449558,"avatar_url":"https://avatars.githubusercontent.com/u/449558?v=3","gravatar_id":"","url":"https://api.github.com/users/amueller","html_url":"https://github.com/amueller","followers_url":"https://api.github.com/users/amueller/followers","following_url":"https://api.github.com/users/amueller/following{/other_user}","gists_url":"https://api.github.com/users/amueller/gists{/gist_id}","starred_url":"https://api.github.com/users/amueller/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amueller/subscriptions","organizations_url":"https://api.github.com/users/amueller/orgs","repos_url":"https://api.github.com/users/amueller/repos","events_url":"https://api.github.com/users/amueller/events{/privacy}","received_events_url":"https://api.github.com/users/amueller/received_events","type":"User","site_admin":false},"created_at":"2016-08-29T22:43:12Z","updated_at":"2016-08-29T22:43:12Z","body":"It looks to me that the outcome of #1156 was a different solution. maybe @larsmans or @ogrisel care to comment?\r\nI would also thing that creating custom analyzers should be made easier. Otherwise we end up with arbitrary many callbacks.\r\nWhat you want to do is relatively easy to achieve by providing a custom analyzer, right? Or is it the ``n_grams`` that give you trouble?\r\n\r\nWe could maybe add an example on how to build a custom analyzer that can handle n-grams?"}}
{"actor":{"display_login":"amueller"}}