{"action":"created","issue":{"url":"https://api.github.com/repos/kubeflow/examples/issues/321","repository_url":"https://api.github.com/repos/kubeflow/examples","labels_url":"https://api.github.com/repos/kubeflow/examples/issues/321/labels{/name}","comments_url":"https://api.github.com/repos/kubeflow/examples/issues/321/comments","events_url":"https://api.github.com/repos/kubeflow/examples/issues/321/events","html_url":"https://github.com/kubeflow/examples/issues/321","id":379345095,"node_id":"MDU6SXNzdWUzNzkzNDUwOTU=","number":321,"title":"[code search] preprocess failed: Can't find model 'en' ","user":{"login":"IronPan","id":2348602,"node_id":"MDQ6VXNlcjIzNDg2MDI=","avatar_url":"https://avatars2.githubusercontent.com/u/2348602?v=4","gravatar_id":"","url":"https://api.github.com/users/IronPan","html_url":"https://github.com/IronPan","followers_url":"https://api.github.com/users/IronPan/followers","following_url":"https://api.github.com/users/IronPan/following{/other_user}","gists_url":"https://api.github.com/users/IronPan/gists{/gist_id}","starred_url":"https://api.github.com/users/IronPan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/IronPan/subscriptions","organizations_url":"https://api.github.com/users/IronPan/orgs","repos_url":"https://api.github.com/users/IronPan/repos","events_url":"https://api.github.com/users/IronPan/events{/privacy}","received_events_url":"https://api.github.com/users/IronPan/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2018-11-09T22:32:54Z","updated_at":"2018-11-11T23:39:26Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"I was following the notebook instruction and got this error when sending preprocess dataflow job\r\n\r\n/root/.local/lib/python2.7/site-packages/scipy/spatial/__init__.py:96: ImportWarning: Not importing directory '/root/.local/lib/python2.7/site-packages/scipy/spatial/qhull': missing __init__.py\r\n  from .qhull import *\r\n/root/.local/lib/python2.7/site-packages/scipy/optimize/_minimize.py:37: ImportWarning: Not importing directory '/root/.local/lib/python2.7/site-packages/scipy/optimize/lbfgsb': missing __init__.py\r\n  from .lbfgsb import _minimize_lbfgsb\r\nTraceback (most recent call last):\r\n  File \"/usr/local/lib/python2.7/runpy.py\", line 174, in _run_module_as_main\r\n    \"__main__\", fname, loader, pkg_name)\r\n  File \"/usr/local/lib/python2.7/runpy.py\", line 72, in _run_code\r\n    exec code in run_globals\r\n  File \"/examples/code_search/src/code_search/dataflow/cli/preprocess_github_dataset.py\", line 7, in <module>\r\n    import code_search.dataflow.transforms.github_dataset as github_dataset\r\n  File \"code_search/dataflow/transforms/github_dataset.py\", line 5, in <module>\r\n    import code_search.dataflow.do_fns.github_dataset as gh_do_fns\r\n  File \"code_search/dataflow/do_fns/github_dataset.py\", line 6, in <module>\r\n    import code_search.dataflow.utils as utils\r\n  File \"code_search/dataflow/utils.py\", line 9, in <module>\r\n    en = spacy.load('en')\r\n  File \"/root/.local/lib/python2.7/site-packages/spacy/__init__.py\", line 21, in load\r\n    return util.load_model(name, **overrides)\r\n  File \"/root/.local/lib/python2.7/site-packages/spacy/util.py\", line 119, in load_model\r\n    raise IOError(Errors.E050.format(name=name))\r\nIOError: [E050] Can't find model 'en'. It doesn't seem to be a shortcut link, a Python package or a valid path to a data directory."},"comment":{"url":"https://api.github.com/repos/kubeflow/examples/issues/comments/437716347","html_url":"https://github.com/kubeflow/examples/issues/321#issuecomment-437716347","issue_url":"https://api.github.com/repos/kubeflow/examples/issues/321","id":437716347,"node_id":"MDEyOklzc3VlQ29tbWVudDQzNzcxNjM0Nw==","user":{"login":"jlewi","id":777219,"node_id":"MDQ6VXNlcjc3NzIxOQ==","avatar_url":"https://avatars3.githubusercontent.com/u/777219?v=4","gravatar_id":"","url":"https://api.github.com/users/jlewi","html_url":"https://github.com/jlewi","followers_url":"https://api.github.com/users/jlewi/followers","following_url":"https://api.github.com/users/jlewi/following{/other_user}","gists_url":"https://api.github.com/users/jlewi/gists{/gist_id}","starred_url":"https://api.github.com/users/jlewi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jlewi/subscriptions","organizations_url":"https://api.github.com/users/jlewi/orgs","repos_url":"https://api.github.com/users/jlewi/repos","events_url":"https://api.github.com/users/jlewi/events{/privacy}","received_events_url":"https://api.github.com/users/jlewi/received_events","type":"User","site_admin":false},"created_at":"2018-11-11T23:39:26Z","updated_at":"2018-11-11T23:39:26Z","author_association":"CONTRIBUTOR","body":"@IronPan Where did you run this?\r\n\r\nThe command above does need to be run in order to have the en package installed.\r\n\r\nIf you are using the Direct Dataflow pipeline runner then you will need to run the above command to have the package installed on your machine.\r\n\r\nHowever, if you run it using the Dataflow runner the package should be installed on all the workers automatically.\r\n\r\nThat's because our setup.py file includes custom commands to install it.\r\nhttps://github.com/kubeflow/examples/blob/c6ff5dbef895c5a4b7e14df150aa33ce2c98e1cd/code_search/src/setup.py#L12"}}
{"actor":{"display_login":"jlewi"}}