{"action":"created","issue":{"url":"https://api.github.com/repos/mynlp/jigg/issues/49","repository_url":"https://api.github.com/repos/mynlp/jigg","labels_url":"https://api.github.com/repos/mynlp/jigg/issues/49/labels{/name}","comments_url":"https://api.github.com/repos/mynlp/jigg/issues/49/comments","events_url":"https://api.github.com/repos/mynlp/jigg/issues/49/events","html_url":"https://github.com/mynlp/jigg/issues/49","id":185045029,"number":49,"title":"JACCG/ CoreNLP annotator error when running pipeline_server.py","user":{"login":"JSB97","id":6333024,"avatar_url":"https://avatars.githubusercontent.com/u/6333024?v=3","gravatar_id":"","url":"https://api.github.com/users/JSB97","html_url":"https://github.com/JSB97","followers_url":"https://api.github.com/users/JSB97/followers","following_url":"https://api.github.com/users/JSB97/following{/other_user}","gists_url":"https://api.github.com/users/JSB97/gists{/gist_id}","starred_url":"https://api.github.com/users/JSB97/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JSB97/subscriptions","organizations_url":"https://api.github.com/users/JSB97/orgs","repos_url":"https://api.github.com/users/JSB97/repos","events_url":"https://api.github.com/users/JSB97/events{/privacy}","received_events_url":"https://api.github.com/users/JSB97/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2016-10-25T08:01:16Z","updated_at":"2016-12-02T07:53:53Z","closed_at":null,"body":"I can run jaccg on the terminal without issue.\nWhen using the below however;\n\n> ./script/pipeline_server.py  -P \"-Xmx4g -cp jigg-0.6.1.jar jigg.pipeline.Pipeline -annotators ssplit,mecab,jaccg\"\n\nThe below error is returned. \n\nI have extended the timeout time to allow the necessary libraries/packages to be loaded, but there still seems to be a problem in returning the command prompt character \">\".\n\nUsing mecab, cabocha annotators works fine. The error is returned with jaccg only.\n\nRunning corenlp with all annotation options also returns a similar error;\n\n> ./script/pipeline_server.py  -P \"-Xmx4g -cp jigg-0.6.1.jar jigg.pipeline.Pipeline -annotators corenlp[tokenize,ssplit,parse,lemma,ner,dcoref]\"\n\nERROR\n`\nINFO:__main__:java -Xmx4g -cp jigg-0.6.1.jar jigg.pipeline.Pipeline -annotators ssplit,mecab,jaccg\nINFO:__main__:Spawn done!\nTraceback (most recent call last):\n  File \"./script/pipeline_server.py\", line 83, in <module>\n    pipeline = Pipeline(options.pipeline)\n  File \"./script/pipeline_server.py\", line 20, in __init__\n    self.pipeline.expect(\"> \", timeout=5000)\n  File \"/usr/local/lib/python2.7/site-packages/pexpect/spawnbase.py\", line 321, in expect\n    timeout, searchwindowsize, async)\n  File \"/usr/local/lib/python2.7/site-packages/pexpect/spawnbase.py\", line 345, in expect_list\n    return exp.expect_loop(timeout)\n  File \"/usr/local/lib/python2.7/site-packages/pexpect/expect.py\", line 105, in expect_loop\n    return self.eof(e)\n  File \"/usr/local/lib/python2.7/site-packages/pexpect/expect.py\", line 50, in eof\n    raise EOF(msg)\npexpect.exceptions.EOF: End Of File (EOF). Empty string style platform.\n<pexpect.pty_spawn.spawn object at 0x10d356810>\ncommand: /usr/bin/java\nargs: ['/usr/bin/java', '-Xmx4g', '-cp', 'jigg-0.6.1.jar', 'jigg.pipeline.Pipeline', '-annotators', 'ssplit,mecab,jaccg']\nbuffer (last 100 chars): ''\nbefore (last 100 chars): '     < str>: Path to the trained model (you can omit this if you load a jar which packs models) []\\r\\n'\nafter: <class 'pexpect.exceptions.EOF'>\nmatch: None\nmatch_index: None\nexitstatus: None\nflag_eof: True\npid: 81078\nchild_fd: 6\nclosed: False\ntimeout: 30\ndelimiter: <class 'pexpect.exceptions.EOF'>\nlogfile: None\nlogfile_read: None\nlogfile_send: None\nmaxread: 2000\nignorecase: False\nsearchwindowsize: None\ndelaybeforesend: 0.05\ndelayafterclose: 0.1\ndelayafterterminate: 0.1\nsearcher: searcher_re:\n    0: re.compile(\"> \")\n`\n"},"comment":{"url":"https://api.github.com/repos/mynlp/jigg/issues/comments/264394878","html_url":"https://github.com/mynlp/jigg/issues/49#issuecomment-264394878","issue_url":"https://api.github.com/repos/mynlp/jigg/issues/49","id":264394878,"user":{"login":"JSB97","id":6333024,"avatar_url":"https://avatars.githubusercontent.com/u/6333024?v=3","gravatar_id":"","url":"https://api.github.com/users/JSB97","html_url":"https://github.com/JSB97","followers_url":"https://api.github.com/users/JSB97/followers","following_url":"https://api.github.com/users/JSB97/following{/other_user}","gists_url":"https://api.github.com/users/JSB97/gists{/gist_id}","starred_url":"https://api.github.com/users/JSB97/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JSB97/subscriptions","organizations_url":"https://api.github.com/users/JSB97/orgs","repos_url":"https://api.github.com/users/JSB97/repos","events_url":"https://api.github.com/users/JSB97/events{/privacy}","received_events_url":"https://api.github.com/users/JSB97/received_events","type":"User","site_admin":false},"created_at":"2016-12-02T07:53:53Z","updated_at":"2016-12-02T07:53:53Z","body":"Likewise - apologies for getting back late. \r\nWith your try/exception modifications here are the outputs.\r\n\r\nFor JACCG, I ran the download script as instructed but get the below error anyway. As evidence that the download script ran successfully, I can see the ```jigg-0.6.1-models.jar``` jar in the ```jigg-0.6.1``` directory.\r\n\r\nFor CoreNLP it seems to be complaining about ```\"edu/stanford/nlp/models/lexparser/englishPCFG.ser.gz\"``` not being available.\r\n\r\n**JACCG**\r\nCommand\r\n```\r\n./script/pipeline_server.py -P \"-Xmx4g -cp jigg-0.6.1.jar jigg.pipeline.Pipeline -annotators ssplit,mecab,jaccg\"\r\n```\r\nOutput\r\n```\r\nINFO:__main__:java -Xmx4g -cp jigg-0.6.1.jar jigg.pipeline.Pipeline -annotators ssplit,mecab,jaccg\r\nINFO:__main__:Spawning Jigg process...\r\nERROR:__main__:Failed to set up the pipeline! Maybe the arguments given to jigg are corrupted?\r\nERROR:__main__:Loading parser model in ccg-models/parser/beam=64.ser.gz ...Loading parser model in ccg-models/parser/beam=64.ser.gz ...Failed to start CCG parser. Make sure the model file of CCG is already installed. If not, execute the following command in jigg directory:\r\n  ./script/download_models.sh\r\n\r\n  jaccg.model                    < str>: Path to the trained model (you can omit this if you load a jar which packs models) []\r\n```\r\n\r\n**CoreNLP with all annotations**\r\nCommand\r\n```\r\n./script/pipeline_server.py -P \"-Xmx4g -cp jigg-0.6.1.jar jigg.pipeline.Pipeline -annotators corenlp[tokenize,ssplit,parse,lemma,ner,dcoref]\"\r\n```\r\nOutput\r\n```\r\nINFO:__main__:Spawning Jigg process...\r\nERROR:__main__:Failed to set up the pipeline! Maybe the arguments given to jigg are corrupted?\r\nERROR:__main__:[main] INFO edu.stanford.nlp.pipeline.StanfordCoreNLP - Adding annotator tokenize\r\n[main] INFO edu.stanford.nlp.pipeline.TokenizerAnnotator - TokenizerAnnotator: No tokenizer type provided. Defaulting to PTBTokenizer.\r\n[main] INFO edu.stanford.nlp.pipeline.StanfordCoreNLP - Adding annotator ssplit\r\n[main] INFO edu.stanford.nlp.pipeline.StanfordCoreNLP - Adding annotator parse\r\n[main] INFO edu.stanford.nlp.parser.common.ParserGrammar - Loading parser from serialized file edu/stanford/nlp/models/lexparser/englishPCFG.ser.gz ... \r\n[main] INFO edu.stanford.nlp.pipeline.StanfordCoreNLP - Adding annotator tokenize\r\n[main] INFO edu.stanford.nlp.pipeline.StanfordCoreNLP - Adding annotator ssplit\r\n[main] INFO edu.stanford.nlp.pipeline.StanfordCoreNLP - Adding annotator parse\r\n[main] INFO edu.stanford.nlp.parser.common.ParserGrammar - Loading parser from serialized file edu/stanford/nlp/models/lexparser/englishPCFG.ser.gz ... \r\nException in thread \"main\" edu.stanford.nlp.io.RuntimeIOException: java.io.IOException: Unable to open \"edu/stanford/nlp/models/lexparser/englishPCFG.ser.gz\" as class path, filename or URL\r\n\tat edu.stanford.nlp.parser.common.ParserGrammar.loadModel(ParserGrammar.java:188)\r\n\tat edu.stanford.nlp.pipeline.ParserAnnotator.loadModel(ParserAnnotator.java:212)\r\n\tat edu.stanford.nlp.pipeline.ParserAnnotator.<init>(ParserAnnotator.java:115)\r\n\tat edu.stanford.nlp.pipeline.AnnotatorImplementations.parse(AnnotatorImplementations.java:150)\r\n\tat edu.stanford.nlp.pipeline.AnnotatorFactories$11.create(AnnotatorFactories.java:463)\r\n\tat edu.stanford.nlp.pipeline.AnnotatorPool.get(AnnotatorPool.java:85)\r\n\tat edu.stanford.nlp.pipeline.StanfordCoreNLP.construct(StanfordCoreNLP.java:375)\r\n\tat edu.stanford.nlp.pipeline.StanfordCoreNLP.<init>(StanfordCoreNLP.java:139)\r\n\tat jigg.pipeline.StanfordCoreNLPAnnotator.<init>(StanfordCoreNLPAnnotator.scala:60)\r\n\tat jigg.pipeline.StanfordCoreNLPAnnotator$.fromProps(StanfordCoreNLPAnnotator.scala:784)\r\n\tat jigg.pipeline.StanfordCoreNLPAnnotator$.fromProps(StanfordCoreNLPAnnotator.scala:747)\r\n\tat jigg.pipeline.Pipeline$$anonfun$getAnnotator$1.apply(Pipeline.scala:185)\r\n\tat jigg.pipeline.Pipeline$$anonfun$getAnnotator$1.apply(Pipeline.scala:185)\r\n\tat scala.Option.map(Option.scala:146)\r\n\tat jigg.pipeline.Pipeline.getAnnotator(Pipeline.scala:184)\r\n\tat jigg.pipeline.Pipeline$$anonfun$5.apply(Pipeline.scala:136)\r\n\tat jigg.pipeline.Pipeline$$anonfun$5.apply(Pipeline.scala:136)\r\n\tat scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:245)\r\n\tat scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:245)\r\n\tat scala.collection.Iterator$class.foreach(Iterator.scala:742)\r\n\tat scala.collection.AbstractIterator.foreach(Iterator.scala:1194)\r\n\tat scala.collection.IterableLike$class.foreach(IterableLike.scala:72)\r\n\tat scala.collection.AbstractIterable.foreach(Iterable.scala:54)\r\n\tat scala.collection.TraversableLike$class.map(TraversableLike.scala:245)\r\n\tat scala.collection.AbstractTraversable.map(Traversable.scala:104)\r\n\tat jigg.pipeline.Pipeline.createAnnotatorList(Pipeline.scala:136)\r\n\tat jigg.pipeline.Pipeline.annotatorList$lzycompute(Pipeline.scala:130)\r\n\tat jigg.pipeline.Pipeline.annotatorList(Pipeline.scala:130)\r\n\tat jigg.pipeline.Pipeline.close(Pipeline.scala:132)\r\n\tat jigg.pipeline.Pipeline$.main(Pipeline.scala:399)\r\n\tat jigg.pipeline.Pipeline.main(Pipeline.scala)\r\nCaused by: java.io.IOException: Unable to open \"edu/stanford/nlp/models/lexparser/englishPCFG.ser.gz\" as class path, filename or URL\r\n\tat edu.stanford.nlp.io.IOUtils.getInputStreamFromURLOrClasspathOrFileSystem(IOUtils.java:485)\r\n\tat edu.stanford.nlp.io.IOUtils.readObjectFromURLOrClasspathOrFileSystem(IOUtils.java:323)\r\n\tat edu.stanford.nlp.parser.common.ParserGrammar.loadModel(ParserGrammar.java:185)\r\n\t... 30 more\r\n```"}}
{"actor":{"display_login":"JSB97"}}