{"action":"created","issue":{"url":"https://api.github.com/repos/dariusk/pos-js/issues/21","repository_url":"https://api.github.com/repos/dariusk/pos-js","labels_url":"https://api.github.com/repos/dariusk/pos-js/issues/21/labels{/name}","comments_url":"https://api.github.com/repos/dariusk/pos-js/issues/21/comments","events_url":"https://api.github.com/repos/dariusk/pos-js/issues/21/events","html_url":"https://github.com/dariusk/pos-js/issues/21","id":154647009,"number":21,"title":"Lexer fails with contractions?","user":{"login":"josephrocca","id":1167575,"avatar_url":"https://avatars.githubusercontent.com/u/1167575?v=3","gravatar_id":"","url":"https://api.github.com/users/josephrocca","html_url":"https://github.com/josephrocca","followers_url":"https://api.github.com/users/josephrocca/followers","following_url":"https://api.github.com/users/josephrocca/following{/other_user}","gists_url":"https://api.github.com/users/josephrocca/gists{/gist_id}","starred_url":"https://api.github.com/users/josephrocca/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/josephrocca/subscriptions","organizations_url":"https://api.github.com/users/josephrocca/orgs","repos_url":"https://api.github.com/users/josephrocca/repos","events_url":"https://api.github.com/users/josephrocca/events{/privacy}","received_events_url":"https://api.github.com/users/josephrocca/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/dariusk/pos-js/labels/enhancement","name":"enhancement","color":"84b6eb"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-05-13T07:05:49Z","updated_at":"2016-09-17T16:07:44Z","closed_at":null,"body":"It seems like it's not parsing contractions properly. it breaks \"wouldn't\" into `wouldn` `'` `t`\r\n\r\nFor example, this snippet: \"Your good, sensible head wouldn't let you do...\" gives the following output:\r\n\r\n```\r\n{\"word\":\"Your\",\"tag\":\"PRP$\"}\r\n{\"word\":\"good\",\"tag\":\"JJ\"}\r\n{\"word\":\",\",\"tag\":\",\"}\r\n{\"word\":\"sensible\",\"tag\":\"JJ\"}\r\n{\"word\":\"head\",\"tag\":\"NN\"}\r\n{\"word\":\"wouldn\",\"tag\":\"NN\"}\r\n{\"word\":\"'\",\"tag\":\"\\\"\"}\r\n{\"word\":\"t\",\"tag\":\"NN\"}\r\n{\"word\":\"let\",\"tag\":\"VB\"}\r\n{\"word\":\"you\",\"tag\":\"PRP\"}\r\n{\"word\":\"do\",\"tag\":\"VBP\"}\r\n```\r\n\r\nThis seems like a pretty big deal, since contractions are fairly common in English.\r\n\r\nThanks for your work on this lib!"},"comment":{"url":"https://api.github.com/repos/dariusk/pos-js/issues/comments/247785022","html_url":"https://github.com/dariusk/pos-js/issues/21#issuecomment-247785022","issue_url":"https://api.github.com/repos/dariusk/pos-js/issues/21","id":247785022,"user":{"login":"MichaelPaulukonis","id":2607898,"avatar_url":"https://avatars.githubusercontent.com/u/2607898?v=3","gravatar_id":"","url":"https://api.github.com/users/MichaelPaulukonis","html_url":"https://github.com/MichaelPaulukonis","followers_url":"https://api.github.com/users/MichaelPaulukonis/followers","following_url":"https://api.github.com/users/MichaelPaulukonis/following{/other_user}","gists_url":"https://api.github.com/users/MichaelPaulukonis/gists{/gist_id}","starred_url":"https://api.github.com/users/MichaelPaulukonis/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MichaelPaulukonis/subscriptions","organizations_url":"https://api.github.com/users/MichaelPaulukonis/orgs","repos_url":"https://api.github.com/users/MichaelPaulukonis/repos","events_url":"https://api.github.com/users/MichaelPaulukonis/events{/privacy}","received_events_url":"https://api.github.com/users/MichaelPaulukonis/received_events","type":"User","site_admin":false},"created_at":"2016-09-17T16:07:44Z","updated_at":"2016-09-17T16:07:44Z","body":"Isn't a common response to pre-process the text with a contraction expander? (\r\n\r\nSome taggers include this, some don't - so I'm not answering the question completely.\r\n\r\n`nlp_compromise` does include a [contraction expander](https://github.com/nlp-compromise/nlp_compromise/blob/c3e3e3f8488be9995f8f92208a1d9f4b974437be/src/sentence/contractions/contract.js).\r\n\r\nIf something like this was include, it could be optionally enabled prior to tagging. \r\n\r\n"}}
{"actor":{"display_login":"MichaelPaulukonis"}}