{"action":"created","issue":{"url":"https://api.github.com/repos/explosion/spaCy/issues/429","repository_url":"https://api.github.com/repos/explosion/spaCy","labels_url":"https://api.github.com/repos/explosion/spaCy/issues/429/labels{/name}","comments_url":"https://api.github.com/repos/explosion/spaCy/issues/429/comments","events_url":"https://api.github.com/repos/explosion/spaCy/issues/429/events","html_url":"https://github.com/explosion/spaCy/issues/429","id":161079771,"number":429,"title":"pipe(): ValueError Error parsing doc","user":{"login":"blang","id":803897,"avatar_url":"https://avatars.githubusercontent.com/u/803897?v=3","gravatar_id":"","url":"https://api.github.com/users/blang","html_url":"https://github.com/blang","followers_url":"https://api.github.com/users/blang/followers","following_url":"https://api.github.com/users/blang/following{/other_user}","gists_url":"https://api.github.com/users/blang/gists{/gist_id}","starred_url":"https://api.github.com/users/blang/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/blang/subscriptions","organizations_url":"https://api.github.com/users/blang/orgs","repos_url":"https://api.github.com/users/blang/repos","events_url":"https://api.github.com/users/blang/events{/privacy}","received_events_url":"https://api.github.com/users/blang/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/explosion/spaCy/labels/bug","name":"bug","color":"E4514F"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/explosion/spaCy/milestones/1","html_url":"https://github.com/explosion/spaCy/milestones/Version%201.0%20Release","labels_url":"https://api.github.com/repos/explosion/spaCy/milestones/1/labels","id":2018336,"number":1,"title":"Version 1.0 Release","description":"Bug fixes, enhancements, documentation for spaCy 1.0.","creator":{"login":"ines","id":13643239,"avatar_url":"https://avatars.githubusercontent.com/u/13643239?v=3","gravatar_id":"","url":"https://api.github.com/users/ines","html_url":"https://github.com/ines","followers_url":"https://api.github.com/users/ines/followers","following_url":"https://api.github.com/users/ines/following{/other_user}","gists_url":"https://api.github.com/users/ines/gists{/gist_id}","starred_url":"https://api.github.com/users/ines/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ines/subscriptions","organizations_url":"https://api.github.com/users/ines/orgs","repos_url":"https://api.github.com/users/ines/repos","events_url":"https://api.github.com/users/ines/events{/privacy}","received_events_url":"https://api.github.com/users/ines/received_events","type":"User","site_admin":false},"open_issues":1,"closed_issues":28,"state":"closed","created_at":"2016-09-21T07:05:02Z","updated_at":"2016-10-27T13:05:23Z","due_on":"2016-10-19T00:00:00Z","closed_at":"2016-10-19T00:36:21Z"},"comments":9,"created_at":"2016-06-19T16:11:15Z","updated_at":"2016-10-27T13:05:24Z","closed_at":null,"body":"I found strange behaviour using the `pipe()` method (only verified on german variant):\r\n\r\nIf you parse a document using `pipe()` you can get a ValueError, while if i use `nlp(text)` everything is fine. I boiled it down to single words, while german words work, english words like 'windows' don't work.\r\n\r\nSteps to reproduce:\r\n```python\r\nimport spacy\r\nnlp = spacy.load('de')\r\ndef texts():\r\n    yield \"Windows\"\r\nfor doc in nlp.pipe(texts(), n_threads=16, batch_size=1000):\r\n    print(len(doc))  # doc access -> ValueError\r\n```\r\n\r\nTrace\r\n```\r\nValueError                                Traceback (most recent call last)\r\n<ipython-input-2-9a095ec5505b> in <module>()\r\n      8 def texts():\r\n      9     yield \"Windows\"\r\n---> 10 for doc in nlp.pipe(texts(), n_threads=16, batch_size=1000):\r\n     11     print(len(doc))\r\n\r\n.../venv/lib/python3.4/site-packages/spacy/language.py in pipe(self, texts, tag, parse, entity, n_threads, batch_size)\r\n    254             stream = self.entity.pipe(stream,\r\n    255                 n_threads=1, batch_size=batch_size)\r\n--> 256         for doc in stream:\r\n    257             yield doc\r\n    258 \r\nValueError: Error parsing doc: Windows\r\n```\r\n\r\nIf you use `nlp(\"Windows\")` it works fine. Also if you execute `nlp(\"Windows\")` before the same `pipe()` call, `pipe()` does not raise an exception (a dictionary is built?)\r\n\r\nVersions:\r\n```\r\nPython 3.4.3 (Problem not related to ipython)\r\nspacy 0.101.0\r\n```\r\n    \r\nMaybe this is related to this region [syntax/parser.pyx](https://github.com/spacy-io/spaCy/blob/1822bb4ff1e6ceee76fe5e43de4345fab168e65b/spacy/syntax/parser.pyx#L179-L183)\r\n```python\r\nif not eg.is_valid[guess]:\r\n    # with gil:\r\n    #     move_name = self.moves.move_name(action.move, action.label)\r\n    #     print 'invalid action:', move_name\r\n    return 1\r\n```"},"comment":{"url":"https://api.github.com/repos/explosion/spaCy/issues/comments/256634895","html_url":"https://github.com/explosion/spaCy/issues/429#issuecomment-256634895","issue_url":"https://api.github.com/repos/explosion/spaCy/issues/429","id":256634895,"user":{"login":"honnibal","id":8059750,"avatar_url":"https://avatars.githubusercontent.com/u/8059750?v=3","gravatar_id":"","url":"https://api.github.com/users/honnibal","html_url":"https://github.com/honnibal","followers_url":"https://api.github.com/users/honnibal/followers","following_url":"https://api.github.com/users/honnibal/following{/other_user}","gists_url":"https://api.github.com/users/honnibal/gists{/gist_id}","starred_url":"https://api.github.com/users/honnibal/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/honnibal/subscriptions","organizations_url":"https://api.github.com/users/honnibal/orgs","repos_url":"https://api.github.com/users/honnibal/repos","events_url":"https://api.github.com/users/honnibal/events{/privacy}","received_events_url":"https://api.github.com/users/honnibal/received_events","type":"User","site_admin":false},"created_at":"2016-10-27T13:05:23Z","updated_at":"2016-10-27T13:05:23Z","body":"Do you have a minute to video chat about this? If so click here:\r\n\r\nhttps://appear.in/spacy_issue429 "}}
{"actor":{"display_login":"honnibal"}}