{"action":"created","issue":{"url":"https://api.github.com/repos/clab/dynet/issues/1382","repository_url":"https://api.github.com/repos/clab/dynet","labels_url":"https://api.github.com/repos/clab/dynet/issues/1382/labels{/name}","comments_url":"https://api.github.com/repos/clab/dynet/issues/1382/comments","events_url":"https://api.github.com/repos/clab/dynet/issues/1382/events","html_url":"https://github.com/clab/dynet/issues/1382","id":326835987,"node_id":"MDU6SXNzdWUzMjY4MzU5ODc=","number":1382,"title":"RuntimeError: Magnitude of gradient is bad: inf","user":{"login":"AmitMY","id":5757359,"node_id":"MDQ6VXNlcjU3NTczNTk=","avatar_url":"https://avatars1.githubusercontent.com/u/5757359?v=4","gravatar_id":"","url":"https://api.github.com/users/AmitMY","html_url":"https://github.com/AmitMY","followers_url":"https://api.github.com/users/AmitMY/followers","following_url":"https://api.github.com/users/AmitMY/following{/other_user}","gists_url":"https://api.github.com/users/AmitMY/gists{/gist_id}","starred_url":"https://api.github.com/users/AmitMY/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmitMY/subscriptions","organizations_url":"https://api.github.com/users/AmitMY/orgs","repos_url":"https://api.github.com/users/AmitMY/repos","events_url":"https://api.github.com/users/AmitMY/events{/privacy}","received_events_url":"https://api.github.com/users/AmitMY/received_events","type":"User","site_admin":false},"labels":[{"id":439660182,"node_id":"MDU6TGFiZWw0Mzk2NjAxODI=","url":"https://api.github.com/repos/clab/dynet/labels/need%20more%20info","name":"need more info","color":"0052cc","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2018-05-27T17:56:27Z","updated_at":"2018-06-27T10:48:31Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"This happens occasionally (once every 20~ runs), stopping my training process:\r\n\r\n> RuntimeError: Magnitude of gradient is bad: inf\r\n\r\nI have not yet managed to replicate this reliably.\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/clab/dynet/issues/comments/400629956","html_url":"https://github.com/clab/dynet/issues/1382#issuecomment-400629956","issue_url":"https://api.github.com/repos/clab/dynet/issues/1382","id":400629956,"node_id":"MDEyOklzc3VlQ29tbWVudDQwMDYyOTk1Ng==","user":{"login":"FilippoC","id":919479,"node_id":"MDQ6VXNlcjkxOTQ3OQ==","avatar_url":"https://avatars3.githubusercontent.com/u/919479?v=4","gravatar_id":"","url":"https://api.github.com/users/FilippoC","html_url":"https://github.com/FilippoC","followers_url":"https://api.github.com/users/FilippoC/followers","following_url":"https://api.github.com/users/FilippoC/following{/other_user}","gists_url":"https://api.github.com/users/FilippoC/gists{/gist_id}","starred_url":"https://api.github.com/users/FilippoC/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/FilippoC/subscriptions","organizations_url":"https://api.github.com/users/FilippoC/orgs","repos_url":"https://api.github.com/users/FilippoC/repos","events_url":"https://api.github.com/users/FilippoC/events{/privacy}","received_events_url":"https://api.github.com/users/FilippoC/received_events","type":"User","site_admin":false},"created_at":"2018-06-27T10:48:31Z","updated_at":"2018-06-27T10:48:31Z","author_association":"CONTRIBUTOR","body":"hi,\r\nI was going to open a new issue, but my problem is related to this one.\r\nI have the same problem, and nothing triggers when using \"cg.set_immediate_compute(true); cg.set_check_validity(true);\"\r\nIs there any way to check which node has a ill-defined gradient in the computational graph?"}}
{"actor":{"display_login":"FilippoC"}}