{"action":"created","issue":{"url":"https://api.github.com/repos/honnibal/spaCy/issues/231","labels_url":"https://api.github.com/repos/honnibal/spaCy/issues/231/labels{/name}","comments_url":"https://api.github.com/repos/honnibal/spaCy/issues/231/comments","events_url":"https://api.github.com/repos/honnibal/spaCy/issues/231/events","html_url":"https://github.com/honnibal/spaCy/issues/231","id":127685795,"number":231,"title":"Sentence Tokenization","user":{"login":"Terrilocks","id":16025737,"avatar_url":"https://avatars.githubusercontent.com/u/16025737?v=3","gravatar_id":"","url":"https://api.github.com/users/Terrilocks","html_url":"https://github.com/Terrilocks","followers_url":"https://api.github.com/users/Terrilocks/followers","following_url":"https://api.github.com/users/Terrilocks/following{/other_user}","gists_url":"https://api.github.com/users/Terrilocks/gists{/gist_id}","starred_url":"https://api.github.com/users/Terrilocks/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Terrilocks/subscriptions","organizations_url":"https://api.github.com/users/Terrilocks/orgs","repos_url":"https://api.github.com/users/Terrilocks/repos","events_url":"https://api.github.com/users/Terrilocks/events{/privacy}","received_events_url":"https://api.github.com/users/Terrilocks/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":6,"created_at":"2016-01-20T13:46:27Z","updated_at":"2016-01-24T15:49:32Z","closed_at":null,"body":"Hi,\r\n\r\nI've run across a few cases where spaCy doesn't sentence tokenize as expected:\r\nE.g.\r\n\"The party will finish quite late so we've decided to provide a bus which would take you to the hotel safely.\"\r\n->\r\n1. The party will finish quite late \r\n2. so we've decided to provide a bus which would take you to the hotel safely.\r\n\r\nIn the few examples I've observed, it always seem to happen around \"so\". I can see why it makes a split there, but is otherwise kind of annoying!\r\n\r\nIs there any work-around?\r\nThanks."},"comment":{"url":"https://api.github.com/repos/honnibal/spaCy/issues/comments/174311039","html_url":"https://github.com/honnibal/spaCy/issues/231#issuecomment-174311039","issue_url":"https://api.github.com/repos/honnibal/spaCy/issues/231","id":174311039,"user":{"login":"bittlingmayer","id":11457984,"avatar_url":"https://avatars.githubusercontent.com/u/11457984?v=3","gravatar_id":"","url":"https://api.github.com/users/bittlingmayer","html_url":"https://github.com/bittlingmayer","followers_url":"https://api.github.com/users/bittlingmayer/followers","following_url":"https://api.github.com/users/bittlingmayer/following{/other_user}","gists_url":"https://api.github.com/users/bittlingmayer/gists{/gist_id}","starred_url":"https://api.github.com/users/bittlingmayer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bittlingmayer/subscriptions","organizations_url":"https://api.github.com/users/bittlingmayer/orgs","repos_url":"https://api.github.com/users/bittlingmayer/repos","events_url":"https://api.github.com/users/bittlingmayer/events{/privacy}","received_events_url":"https://api.github.com/users/bittlingmayer/received_events","type":"User","site_admin":false},"created_at":"2016-01-24T15:49:32Z","updated_at":"2016-01-24T15:49:32Z","body":"Very unexpected result from my short term solution to add an extra space: while it fixed that one case, in all or almost all the other cases (in a sample of 300, where most have \"! \") it failed to find sentence boundaries.\r\n\r\nhttps://api.spacy.io/displacy/index.html?full=They%20look%20so%20real!%20%20Wonderful%20seller%20to%20deal%20with%2C%20too!%20%20A%2B%2B%2B%2B"}}