{"action":"created","issue":{"url":"https://api.github.com/repos/google-research/bert/issues/250","repository_url":"https://api.github.com/repos/google-research/bert","labels_url":"https://api.github.com/repos/google-research/bert/issues/250/labels{/name}","comments_url":"https://api.github.com/repos/google-research/bert/issues/250/comments","events_url":"https://api.github.com/repos/google-research/bert/issues/250/events","html_url":"https://github.com/google-research/bert/issues/250","id":389586931,"node_id":"MDU6SXNzdWUzODk1ODY5MzE=","number":250,"title":"run_classifier: clip_by_global_norm got nan/inf","user":{"login":"anpark","id":12320255,"node_id":"MDQ6VXNlcjEyMzIwMjU1","avatar_url":"https://avatars1.githubusercontent.com/u/12320255?v=4","gravatar_id":"","url":"https://api.github.com/users/anpark","html_url":"https://github.com/anpark","followers_url":"https://api.github.com/users/anpark/followers","following_url":"https://api.github.com/users/anpark/following{/other_user}","gists_url":"https://api.github.com/users/anpark/gists{/gist_id}","starred_url":"https://api.github.com/users/anpark/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/anpark/subscriptions","organizations_url":"https://api.github.com/users/anpark/orgs","repos_url":"https://api.github.com/users/anpark/repos","events_url":"https://api.github.com/users/anpark/events{/privacy}","received_events_url":"https://api.github.com/users/anpark/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-12-11T03:57:44Z","updated_at":"2018-12-11T12:57:42Z","closed_at":null,"author_association":"NONE","body":"I'm using tf 1.12, and \"tensorflow/python/ops/clip_ops.py\", line 265, in clip_by_global_norm got nan error.\r\n\r\nFound Inf or NaN global norm. : Tensor had Inf values \r\n\r\nbatch size: 256, max_seq_len: 82, num_labels: 221\r\n\r\nAny one can help?\r\n-------------------\r\n\r\nupdate: if batch size :128, it's ok"},"comment":{"url":"https://api.github.com/repos/google-research/bert/issues/comments/446193164","html_url":"https://github.com/google-research/bert/issues/250#issuecomment-446193164","issue_url":"https://api.github.com/repos/google-research/bert/issues/250","id":446193164,"node_id":"MDEyOklzc3VlQ29tbWVudDQ0NjE5MzE2NA==","user":{"login":"xwzhong","id":18318440,"node_id":"MDQ6VXNlcjE4MzE4NDQw","avatar_url":"https://avatars2.githubusercontent.com/u/18318440?v=4","gravatar_id":"","url":"https://api.github.com/users/xwzhong","html_url":"https://github.com/xwzhong","followers_url":"https://api.github.com/users/xwzhong/followers","following_url":"https://api.github.com/users/xwzhong/following{/other_user}","gists_url":"https://api.github.com/users/xwzhong/gists{/gist_id}","starred_url":"https://api.github.com/users/xwzhong/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/xwzhong/subscriptions","organizations_url":"https://api.github.com/users/xwzhong/orgs","repos_url":"https://api.github.com/users/xwzhong/repos","events_url":"https://api.github.com/users/xwzhong/events{/privacy}","received_events_url":"https://api.github.com/users/xwzhong/received_events","type":"User","site_admin":false},"created_at":"2018-12-11T12:57:42Z","updated_at":"2018-12-11T12:57:42Z","author_association":"NONE","body":"I got the error when pretraining, did you use your own vocab file? if you use it, you may check bert_config.json setting (vocab size)."}}
{"actor":{"display_login":"xwzhong"}}