{"action":"created","issue":{"url":"https://api.github.com/repos/LanguageMachines/frog/issues/57","repository_url":"https://api.github.com/repos/LanguageMachines/frog","labels_url":"https://api.github.com/repos/LanguageMachines/frog/issues/57/labels{/name}","comments_url":"https://api.github.com/repos/LanguageMachines/frog/issues/57/comments","events_url":"https://api.github.com/repos/LanguageMachines/frog/issues/57/events","html_url":"https://github.com/LanguageMachines/frog/issues/57","id":341902951,"node_id":"MDU6SXNzdWUzNDE5MDI5NTE=","number":57,"title":"Frog NER fails with folia::NoSuchAnnotation","user":{"login":"proycon","id":75427,"node_id":"MDQ6VXNlcjc1NDI3","avatar_url":"https://avatars3.githubusercontent.com/u/75427?v=4","gravatar_id":"","url":"https://api.github.com/users/proycon","html_url":"https://github.com/proycon","followers_url":"https://api.github.com/users/proycon/followers","following_url":"https://api.github.com/users/proycon/following{/other_user}","gists_url":"https://api.github.com/users/proycon/gists{/gist_id}","starred_url":"https://api.github.com/users/proycon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/proycon/subscriptions","organizations_url":"https://api.github.com/users/proycon/orgs","repos_url":"https://api.github.com/users/proycon/repos","events_url":"https://api.github.com/users/proycon/events{/privacy}","received_events_url":"https://api.github.com/users/proycon/received_events","type":"User","site_admin":false},"labels":[{"id":104767457,"node_id":"MDU6TGFiZWwxMDQ3Njc0NTc=","url":"https://api.github.com/repos/LanguageMachines/frog/labels/bug","name":"bug","color":"fc2929","default":true}],"state":"open","locked":false,"assignee":{"login":"kosloot","id":5870017,"node_id":"MDQ6VXNlcjU4NzAwMTc=","avatar_url":"https://avatars1.githubusercontent.com/u/5870017?v=4","gravatar_id":"","url":"https://api.github.com/users/kosloot","html_url":"https://github.com/kosloot","followers_url":"https://api.github.com/users/kosloot/followers","following_url":"https://api.github.com/users/kosloot/following{/other_user}","gists_url":"https://api.github.com/users/kosloot/gists{/gist_id}","starred_url":"https://api.github.com/users/kosloot/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kosloot/subscriptions","organizations_url":"https://api.github.com/users/kosloot/orgs","repos_url":"https://api.github.com/users/kosloot/repos","events_url":"https://api.github.com/users/kosloot/events{/privacy}","received_events_url":"https://api.github.com/users/kosloot/received_events","type":"User","site_admin":false},"assignees":[{"login":"kosloot","id":5870017,"node_id":"MDQ6VXNlcjU4NzAwMTc=","avatar_url":"https://avatars1.githubusercontent.com/u/5870017?v=4","gravatar_id":"","url":"https://api.github.com/users/kosloot","html_url":"https://github.com/kosloot","followers_url":"https://api.github.com/users/kosloot/followers","following_url":"https://api.github.com/users/kosloot/following{/other_user}","gists_url":"https://api.github.com/users/kosloot/gists{/gist_id}","starred_url":"https://api.github.com/users/kosloot/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kosloot/subscriptions","organizations_url":"https://api.github.com/users/kosloot/orgs","repos_url":"https://api.github.com/users/kosloot/repos","events_url":"https://api.github.com/users/kosloot/events{/privacy}","received_events_url":"https://api.github.com/users/kosloot/received_events","type":"User","site_admin":false}],"milestone":null,"comments":0,"created_at":"2018-07-17T12:43:44Z","updated_at":"2018-07-21T17:34:12Z","closed_at":null,"author_association":"MEMBER","body":"When running on ``mlp09``:\r\n\r\n```\r\nfrog -c /vol/tensusers/proycon/nederlab/nederlab-linguistic-enrichment/resources/frog-crmgys-cgn/frog.cfg --override tokenizer.rulesFile=tokconfig-nld-historical --threads 1 --nostdout -x /scratch/proycon/Corpus-Middelnederlands-1-1_08f16391-7a88-4b37-b967-4f398e604972.folia.xml\r\n```\r\n\r\nNER fails with the following:\r\n\r\n```\r\nfrog-:Tue Jul 17 14:35:28 2018 process 721 sentences\r\nfrog-:Tue Jul 17 14:35:28 2018 done with sentence[1]\r\nterminate called after throwing an instance of 'folia::NoSuchAnnotation'\r\n  what():  no such annotation: entities for set='http://ilk.uvt.nl/folia/sets/frog-ner-nl'\r\n\r\nProgram received signal SIGABRT, Aborted.\r\n0x00002aaaaca29428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54\r\n54      ../sysdeps/unix/sysv/linux/raise.c: No such file or directory.\r\n(gdb) bt\r\n#0  0x00002aaaaca29428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54\r\n#1  0x00002aaaaca2b02a in __GI_abort () at abort.c:89\r\n#2  0x00002aaaac2ce84d in __gnu_cxx::__verbose_terminate_handler() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6\r\n#3  0x00002aaaac2cc6b6 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6\r\n#4  0x00002aaaac2cc701 in std::terminate() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6\r\n#5  0x00002aaaaadc738c in folia::EntitiesLayer::EntitiesLayer (d=<optimized out>, a=std::map with 2 elements = {...}, this=0x3f32e480, __in_chrg=<optimized out>, __vtt_parm=<optimized out>)\r\n    at /vol/customopt/lamachine16.dev/include/libfolia/folia_impl.h:2441\r\n#6  addEntity (sent=sent@entry=0x4127f810, tagset=\"http://ilk.uvt.nl/folia/sets/frog-ner-nl\", words=std::vector of length 1, capacity 1 = {...}, confs=std::vector of length 1, capacity 1 = {...}, NER=\"per\", textclass=\"current\") at ner_tagger_mod.cxx:257\r\n#7  0x00002aaaaadc7989 in NERTagger::addNERTags (this=this@entry=0x274902b0, words=std::vector of length 47, capacity 64 = {...}, tags=std::vector of length 47, capacity 64 = {...}, confs=std::vector of length 47, capacity 64 = {...})\r\n    at ner_tagger_mod.cxx:314\r\n#8  0x00002aaaaadc87b3 in NERTagger::post_process (this=this@entry=0x274902b0, swords=std::vector of length 47, capacity 64 = {...}, override=std::vector of length 47, capacity 47 = {...}) at ner_tagger_mod.cxx:519\r\n#9  0x00002aaaaadca393 in NERTagger::Classify (this=0x274902b0, swords=std::vector of length 47, capacity 64 = {...}) at ner_tagger_mod.cxx:410\r\n#10 0x00002aaaaad477f1 in FrogAPI::TestSentence () at FrogAPI.cxx:577\r\n#11 0x00002aaaad5b212f in GOMP_parallel_sections () from /usr/lib/x86_64-linux-gnu/libgomp.so.1\r\n#12 0x00002aaaaad47ba5 in FrogAPI::TestSentence (this=this@entry=0x7fffffffcb10, sent=<optimized out>, timers=...) at FrogAPI.cxx:567\r\n#13 0x00002aaaaad48161 in FrogAPI::FrogDoc (this=this@entry=0x7fffffffcb10, doc=..., hidetimers=hidetimers@entry=false) at FrogAPI.cxx:1383\r\n#14 0x00002aaaaad56dab in FrogAPI::FrogFile (this=this@entry=0x7fffffffcb10, infilename=\"input/Corpus-Middelnederlands-1-1_08f16391-7a88-4b37-b967-4f398e604972.folia.xml\", os=..., xmlOutF=\"\") at FrogAPI.cxx:1500\r\n#15 0x00000000004057a7 in main (argc=<optimized out>, argv=<optimized out>) at Frog.cxx:631\r\n```\r\n\r\nFrog with regular model also fails, but without the addNERtags error:\r\n\r\n```\r\nfrog-:Tue Jul 17 14:42:04 2018 process 721 sentences\r\nfrog-:Tue Jul 17 14:42:04 2018 done with sentence[1]\r\nterminate called without an active exception\r\n\r\nThread 1 \"frog\" received signal SIGABRT, Aborted.\r\n0x00002aaaaca29428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54\r\n54      ../sysdeps/unix/sysv/linux/raise.c: No such file or directory.\r\n(gdb) bt\r\n#0  0x00002aaaaca29428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54\r\n#1  0x00002aaaaca2b02a in __GI_abort () at abort.c:89\r\n#2  0x00002aaaac2ce84d in __gnu_cxx::__verbose_terminate_handler() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6\r\n#3  0x00002aaaac2cc6b6 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6\r\n#4  0x00002aaaac2cc701 in std::terminate() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6\r\n#5  0x00002aaaaad9a3c4 in folia::AbstractAnnotationLayer::~AbstractAnnotationLayer (__vtt_parm=<optimized out>, this=<optimized out>, __in_chrg=<optimized out>) at /vol/customopt/lamachine16.dev/include/libfolia/folia_impl.h:2088\r\n#6  folia::EntitiesLayer::EntitiesLayer (d=<optimized out>, a=std::map with 2 elements = {...}, this=0x16d27320, __in_chrg=<optimized out>, __vtt_parm=<optimized out>) at /vol/customopt/lamachine16.dev/include/libfolia/folia_impl.h:2441\r\n#7  mwuAna::addEntity (this=0x16d16390, tagset=\"http://ilk.uvt.nl/folia/sets/frog-mwu-nl\", textclass=\"current\", sent=sent@entry=0x17857880, el=<optimized out>) at mwu_chunker_mod.cxx:78\r\n#8  0x00002aaaaad9a555 in Mwu::Classify (this=0x2aaad00008c0, words=...) at mwu_chunker_mod.cxx:248\r\n#9  0x00002aaaaad47851 in FrogAPI::TestSentence () at FrogAPI.cxx:605\r\n#10 0x00002aaaad5b212f in GOMP_parallel_sections () from /usr/lib/x86_64-linux-gnu/libgomp.so.1\r\n#11 0x00002aaaaad47ba5 in FrogAPI::TestSentence (this=this@entry=0x7fffffffcbb0, sent=<optimized out>, timers=...) at FrogAPI.cxx:567\r\n#12 0x00002aaaaad48161 in FrogAPI::FrogDoc (this=this@entry=0x7fffffffcbb0, doc=..., hidetimers=hidetimers@entry=false) at FrogAPI.cxx:1383\r\n#13 0x00002aaaaad56dab in FrogAPI::FrogFile (this=this@entry=0x7fffffffcbb0, infilename=\"inp\r\n```\r\n\r\nSomething fishy is going on...\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/LanguageMachines/frog/issues/comments/406811711","html_url":"https://github.com/LanguageMachines/frog/issues/57#issuecomment-406811711","issue_url":"https://api.github.com/repos/LanguageMachines/frog/issues/57","id":406811711,"node_id":"MDEyOklzc3VlQ29tbWVudDQwNjgxMTcxMQ==","user":{"login":"kosloot","id":5870017,"node_id":"MDQ6VXNlcjU4NzAwMTc=","avatar_url":"https://avatars1.githubusercontent.com/u/5870017?v=4","gravatar_id":"","url":"https://api.github.com/users/kosloot","html_url":"https://github.com/kosloot","followers_url":"https://api.github.com/users/kosloot/followers","following_url":"https://api.github.com/users/kosloot/following{/other_user}","gists_url":"https://api.github.com/users/kosloot/gists{/gist_id}","starred_url":"https://api.github.com/users/kosloot/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kosloot/subscriptions","organizations_url":"https://api.github.com/users/kosloot/orgs","repos_url":"https://api.github.com/users/kosloot/repos","events_url":"https://api.github.com/users/kosloot/events{/privacy}","received_events_url":"https://api.github.com/users/kosloot/received_events","type":"User","site_admin":false},"created_at":"2018-07-21T17:34:12Z","updated_at":"2018-07-21T17:34:12Z","author_association":"COLLABORATOR","body":"Ok, I am on holidays, but...\r\n\r\nThe error seems to suggest that the entities declaration is missing from the folia document.\r\nWhich is odd, as it is added whenever the NER is involved. (or should be)\r\n\r\nWithout knowing which input files are used, debugging will be hard, so provide more details, so I can look into this after the holidays...\r\n\r\n"}}
{"actor":{"display_login":"kosloot"}}