{"action":"created","issue":{"url":"https://api.github.com/repos/bootphon/wordseg/issues/30","repository_url":"https://api.github.com/repos/bootphon/wordseg","labels_url":"https://api.github.com/repos/bootphon/wordseg/issues/30/labels{/name}","comments_url":"https://api.github.com/repos/bootphon/wordseg/issues/30/comments","events_url":"https://api.github.com/repos/bootphon/wordseg/issues/30/events","html_url":"https://github.com/bootphon/wordseg/issues/30","id":301444716,"number":30,"title":"dibs baseline/phrasal not distinguished & performance too low","user":{"login":"alecristia","id":7464861,"avatar_url":"https://avatars0.githubusercontent.com/u/7464861?v=4","gravatar_id":"","url":"https://api.github.com/users/alecristia","html_url":"https://github.com/alecristia","followers_url":"https://api.github.com/users/alecristia/followers","following_url":"https://api.github.com/users/alecristia/following{/other_user}","gists_url":"https://api.github.com/users/alecristia/gists{/gist_id}","starred_url":"https://api.github.com/users/alecristia/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alecristia/subscriptions","organizations_url":"https://api.github.com/users/alecristia/orgs","repos_url":"https://api.github.com/users/alecristia/repos","events_url":"https://api.github.com/users/alecristia/events{/privacy}","received_events_url":"https://api.github.com/users/alecristia/received_events","type":"User","site_admin":false},"labels":[{"id":599546719,"url":"https://api.github.com/repos/bootphon/wordseg/labels/bug","name":"bug","color":"ee0701","default":true}],"state":"open","locked":false,"assignee":{"login":"mmmaat","id":7275460,"avatar_url":"https://avatars2.githubusercontent.com/u/7275460?v=4","gravatar_id":"","url":"https://api.github.com/users/mmmaat","html_url":"https://github.com/mmmaat","followers_url":"https://api.github.com/users/mmmaat/followers","following_url":"https://api.github.com/users/mmmaat/following{/other_user}","gists_url":"https://api.github.com/users/mmmaat/gists{/gist_id}","starred_url":"https://api.github.com/users/mmmaat/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mmmaat/subscriptions","organizations_url":"https://api.github.com/users/mmmaat/orgs","repos_url":"https://api.github.com/users/mmmaat/repos","events_url":"https://api.github.com/users/mmmaat/events{/privacy}","received_events_url":"https://api.github.com/users/mmmaat/received_events","type":"User","site_admin":false},"assignees":[{"login":"mmmaat","id":7275460,"avatar_url":"https://avatars2.githubusercontent.com/u/7275460?v=4","gravatar_id":"","url":"https://api.github.com/users/mmmaat","html_url":"https://github.com/mmmaat","followers_url":"https://api.github.com/users/mmmaat/followers","following_url":"https://api.github.com/users/mmmaat/following{/other_user}","gists_url":"https://api.github.com/users/mmmaat/gists{/gist_id}","starred_url":"https://api.github.com/users/mmmaat/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mmmaat/subscriptions","organizations_url":"https://api.github.com/users/mmmaat/orgs","repos_url":"https://api.github.com/users/mmmaat/repos","events_url":"https://api.github.com/users/mmmaat/events{/privacy}","received_events_url":"https://api.github.com/users/mmmaat/received_events","type":"User","site_admin":false},{"login":"alecristia","id":7464861,"avatar_url":"https://avatars0.githubusercontent.com/u/7464861?v=4","gravatar_id":"","url":"https://api.github.com/users/alecristia","html_url":"https://github.com/alecristia","followers_url":"https://api.github.com/users/alecristia/followers","following_url":"https://api.github.com/users/alecristia/following{/other_user}","gists_url":"https://api.github.com/users/alecristia/gists{/gist_id}","starred_url":"https://api.github.com/users/alecristia/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alecristia/subscriptions","organizations_url":"https://api.github.com/users/alecristia/orgs","repos_url":"https://api.github.com/users/alecristia/repos","events_url":"https://api.github.com/users/alecristia/events{/privacy}","received_events_url":"https://api.github.com/users/alecristia/received_events","type":"User","site_admin":false},{"login":"elinlarsen","id":9362122,"avatar_url":"https://avatars1.githubusercontent.com/u/9362122?v=4","gravatar_id":"","url":"https://api.github.com/users/elinlarsen","html_url":"https://github.com/elinlarsen","followers_url":"https://api.github.com/users/elinlarsen/followers","following_url":"https://api.github.com/users/elinlarsen/following{/other_user}","gists_url":"https://api.github.com/users/elinlarsen/gists{/gist_id}","starred_url":"https://api.github.com/users/elinlarsen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/elinlarsen/subscriptions","organizations_url":"https://api.github.com/users/elinlarsen/orgs","repos_url":"https://api.github.com/users/elinlarsen/repos","events_url":"https://api.github.com/users/elinlarsen/events{/privacy}","received_events_url":"https://api.github.com/users/elinlarsen/received_events","type":"User","site_admin":false}],"milestone":null,"comments":7,"created_at":"2018-03-01T15:22:37Z","updated_at":"2018-03-08T10:23:23Z","closed_at":null,"author_association":"COLLABORATOR","body":"I reanalyzed Bernstein ADS, which yielded a token F score of 0.2487 prior to Dec 2017 on CDSwordseg. Now in wordseg I get 0.1173 (with first 200 lines, as before; even lower if whole corpus used for training). And further the scores for baseline and phrasal are identical:\r\n\r\nres_dibs_baseline_prep_200.txt:token_precision\t0.1173\r\nres_dibs_baseline_prep_prep.txt:token_precision\t0.06634\r\nres_dibs_phrasal_prep_200.txt:token_precision\t0.1173\r\nres_dibs_phrasal_prep_prep.txt:token_precision\t0.06634\r\n\r\nGladys, were you replicating Elin's results precisely? And what were they? \r\n\r\nThe code used for the test was:\r\n```\r\nfor type in phrasal baseline ; do\r\n\r\n        wordseg-dibs -t $type -o dibs_${type}_prep_200.txt prepared.txt first200.txt\r\n        wordseg-dibs -t $type -o dibs_${type}_prep_prep.txt prepared.txt prepared.txt\r\n        wordseg-dibs -t $type -o dibs_${type}_200_prep.txt first200.txt prepared.txt\r\ndone\r\n\r\nfor j in dibs*.txt ; do\r\n        cat $j | wordseg-eval gold.txt > res_${j}\r\ndone\r\n```\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/bootphon/wordseg/issues/comments/371445635","html_url":"https://github.com/bootphon/wordseg/issues/30#issuecomment-371445635","issue_url":"https://api.github.com/repos/bootphon/wordseg/issues/30","id":371445635,"user":{"login":"GladB","id":26108712,"avatar_url":"https://avatars0.githubusercontent.com/u/26108712?v=4","gravatar_id":"","url":"https://api.github.com/users/GladB","html_url":"https://github.com/GladB","followers_url":"https://api.github.com/users/GladB/followers","following_url":"https://api.github.com/users/GladB/following{/other_user}","gists_url":"https://api.github.com/users/GladB/gists{/gist_id}","starred_url":"https://api.github.com/users/GladB/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/GladB/subscriptions","organizations_url":"https://api.github.com/users/GladB/orgs","repos_url":"https://api.github.com/users/GladB/repos","events_url":"https://api.github.com/users/GladB/events{/privacy}","received_events_url":"https://api.github.com/users/GladB/received_events","type":"User","site_admin":false},"created_at":"2018-03-08T10:23:23Z","updated_at":"2018-03-08T10:23:23Z","author_association":"NONE","body":"I did see a difference using baseline, but I never used phrasal, so I couldn't say"}}
{"actor":{"display_login":"GladB"}}