{"action":"opened","issue":{"url":"https://api.github.com/repos/explosion/spaCy/issues/2744","repository_url":"https://api.github.com/repos/explosion/spaCy","labels_url":"https://api.github.com/repos/explosion/spaCy/issues/2744/labels{/name}","comments_url":"https://api.github.com/repos/explosion/spaCy/issues/2744/comments","events_url":"https://api.github.com/repos/explosion/spaCy/issues/2744/events","html_url":"https://github.com/explosion/spaCy/issues/2744","id":357762946,"node_id":"MDU6SXNzdWUzNTc3NjI5NDY=","number":2744,"title":"spaCy loops indefinetly during parsing of a typo ridden sentence","user":{"login":"frenando","id":9635605,"node_id":"MDQ6VXNlcjk2MzU2MDU=","avatar_url":"https://avatars2.githubusercontent.com/u/9635605?v=4","gravatar_id":"","url":"https://api.github.com/users/frenando","html_url":"https://github.com/frenando","followers_url":"https://api.github.com/users/frenando/followers","following_url":"https://api.github.com/users/frenando/following{/other_user}","gists_url":"https://api.github.com/users/frenando/gists{/gist_id}","starred_url":"https://api.github.com/users/frenando/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/frenando/subscriptions","organizations_url":"https://api.github.com/users/frenando/orgs","repos_url":"https://api.github.com/users/frenando/repos","events_url":"https://api.github.com/users/frenando/events{/privacy}","received_events_url":"https://api.github.com/users/frenando/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-09-06T17:57:06Z","updated_at":"2018-09-06T17:57:06Z","closed_at":null,"author_association":"NONE","body":"While trying to parse a large file with multiple tweets I found one which is completely typo ridden (using punctuation instead of spaces, mispellings, etc.), this specific text chain causes spaCy tokenizer to loop indefinetly.\r\n\r\n## How to reproduce the behaviour\r\nimport spacy\r\nnlp = spacy.load(\"es_core_news_sm\")\r\ndoc = nlp(u'Me pongo alas vivas.por favor vendan alitas.de pavo.piernas.huacales.crudos.va.colitas.rostizadas.como.en.cd.juarez.chihuagua.va.gracias.')\r\n\r\n## Your Environment\r\n\r\n* Operating System: Windows 10-10.0.1734-SP0\r\n* Python Version Used: 3.6.6\r\n* spaCy Version Used: 2.0.11\r\n* Environment Information: Models: \"es\"\r\n"}}
{"actor":{"display_login":"frenando"}}