{"action":"opened","issue":{"url":"https://api.github.com/repos/allenai/bilm-tf/issues/113","repository_url":"https://api.github.com/repos/allenai/bilm-tf","labels_url":"https://api.github.com/repos/allenai/bilm-tf/issues/113/labels{/name}","comments_url":"https://api.github.com/repos/allenai/bilm-tf/issues/113/comments","events_url":"https://api.github.com/repos/allenai/bilm-tf/issues/113/events","html_url":"https://github.com/allenai/bilm-tf/issues/113","id":370411385,"node_id":"MDU6SXNzdWUzNzA0MTEzODU=","number":113,"title":"Getting high perplexity with provided checkpoint","user":{"login":"chaonan99","id":13306136,"node_id":"MDQ6VXNlcjEzMzA2MTM2","avatar_url":"https://avatars0.githubusercontent.com/u/13306136?v=4","gravatar_id":"","url":"https://api.github.com/users/chaonan99","html_url":"https://github.com/chaonan99","followers_url":"https://api.github.com/users/chaonan99/followers","following_url":"https://api.github.com/users/chaonan99/following{/other_user}","gists_url":"https://api.github.com/users/chaonan99/gists{/gist_id}","starred_url":"https://api.github.com/users/chaonan99/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chaonan99/subscriptions","organizations_url":"https://api.github.com/users/chaonan99/orgs","repos_url":"https://api.github.com/users/chaonan99/repos","events_url":"https://api.github.com/users/chaonan99/events{/privacy}","received_events_url":"https://api.github.com/users/chaonan99/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-10-16T02:15:08Z","updated_at":"2018-10-16T02:15:08Z","closed_at":null,"author_association":"NONE","body":"I use the checkpoint and vocabulary provided in https://github.com/allenai/bilm-tf#frequently-asked-questions-and-other-warnings and try to run test on the test data in `tests/fixtures/train/data.txt`\r\n\r\n```\r\nCUDA_VISIBLE_DEVICES=2 python run_test.py --save_dir path/to/checkpoint --vocab_file path/to/vocab-2016-09-10.txt --test_prefix ../tests/fixtures/train/data.txt --batch_size 1\r\n```\r\n\r\nI got average perplexity of 377.68. Did I use the checkpoint correctly?"}}
{"actor":{"display_login":"chaonan99"}}