{"action":"closed","issue":{"url":"https://api.github.com/repos/google-research/bert/issues/149","repository_url":"https://api.github.com/repos/google-research/bert","labels_url":"https://api.github.com/repos/google-research/bert/issues/149/labels{/name}","comments_url":"https://api.github.com/repos/google-research/bert/issues/149/comments","events_url":"https://api.github.com/repos/google-research/bert/issues/149/events","html_url":"https://github.com/google-research/bert/issues/149","id":382542384,"node_id":"MDU6SXNzdWUzODI1NDIzODQ=","number":149,"title":"the vocab size of pretrained model is small","user":{"login":"susht3","id":12723964,"node_id":"MDQ6VXNlcjEyNzIzOTY0","avatar_url":"https://avatars0.githubusercontent.com/u/12723964?v=4","gravatar_id":"","url":"https://api.github.com/users/susht3","html_url":"https://github.com/susht3","followers_url":"https://api.github.com/users/susht3/followers","following_url":"https://api.github.com/users/susht3/following{/other_user}","gists_url":"https://api.github.com/users/susht3/gists{/gist_id}","starred_url":"https://api.github.com/users/susht3/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/susht3/subscriptions","organizations_url":"https://api.github.com/users/susht3/orgs","repos_url":"https://api.github.com/users/susht3/repos","events_url":"https://api.github.com/users/susht3/events{/privacy}","received_events_url":"https://api.github.com/users/susht3/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2018-11-20T08:00:18Z","updated_at":"2018-11-23T22:09:47Z","closed_at":"2018-11-23T22:09:47Z","author_association":"NONE","body":"i download model of BERT-Base, Uncased(12-layer, 768-hidden, 12-heads, 110M parameters), whose file name is \"uncased_L-12_H-768_A-12\", and i find the vocab size is very small, only 30522.\r\nfor QA tasks, the vocab size maybe not big enough, some un-frequent words can be answer, if we load this pretrained model, will it performs worse?"}}
{"actor":{"display_login":"jacobdevlin-google"}}