{"action":"created","issue":{"url":"https://api.github.com/repos/lovecambi/qebrain/issues/2","repository_url":"https://api.github.com/repos/lovecambi/qebrain","labels_url":"https://api.github.com/repos/lovecambi/qebrain/issues/2/labels{/name}","comments_url":"https://api.github.com/repos/lovecambi/qebrain/issues/2/comments","events_url":"https://api.github.com/repos/lovecambi/qebrain/issues/2/events","html_url":"https://github.com/lovecambi/qebrain/issues/2","id":394899952,"node_id":"MDU6SXNzdWUzOTQ4OTk5NTI=","number":2,"title":"Checkpoint error","user":{"login":"dimitarsh1","id":15775250,"node_id":"MDQ6VXNlcjE1Nzc1MjUw","avatar_url":"https://avatars3.githubusercontent.com/u/15775250?v=4","gravatar_id":"","url":"https://api.github.com/users/dimitarsh1","html_url":"https://github.com/dimitarsh1","followers_url":"https://api.github.com/users/dimitarsh1/followers","following_url":"https://api.github.com/users/dimitarsh1/following{/other_user}","gists_url":"https://api.github.com/users/dimitarsh1/gists{/gist_id}","starred_url":"https://api.github.com/users/dimitarsh1/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dimitarsh1/subscriptions","organizations_url":"https://api.github.com/users/dimitarsh1/orgs","repos_url":"https://api.github.com/users/dimitarsh1/repos","events_url":"https://api.github.com/users/dimitarsh1/events{/privacy}","received_events_url":"https://api.github.com/users/dimitarsh1/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-12-30T20:39:40Z","updated_at":"2018-12-31T12:30:13Z","closed_at":null,"author_association":"NONE","body":"Hello\r\n\r\nSometimes the exp_train succeeds and sometimes it fails with the following error:\r\n\r\n.....\r\nDataLossError (see above for traceback): Checksum does not match: stored 1669981049 vs. calculated on the restored bytes 3056795359\r\n         [[node save/RestoreV2 (defined at expert_model.py:738)  = RestoreV2[dtypes=[DT_FLOAT, DT_FLOAT, DT_INT32, DT_INT64, DT_FLOAT, ..., DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT], _device=\"/job:localhost/replica:0/task:0/device:CPU:0\"](_arg_save/Const_0_0, save/RestoreV2/tensor_names, save/RestoreV2/shape_and_slices)]]\r\n\r\nAny idea what can be the problem?\r\n\r\nThanks, \r\nCheers,\r\nDimitar"},"comment":{"url":"https://api.github.com/repos/lovecambi/qebrain/issues/comments/450640692","html_url":"https://github.com/lovecambi/qebrain/issues/2#issuecomment-450640692","issue_url":"https://api.github.com/repos/lovecambi/qebrain/issues/2","id":450640692,"node_id":"MDEyOklzc3VlQ29tbWVudDQ1MDY0MDY5Mg==","user":{"login":"dimitarsh1","id":15775250,"node_id":"MDQ6VXNlcjE1Nzc1MjUw","avatar_url":"https://avatars3.githubusercontent.com/u/15775250?v=4","gravatar_id":"","url":"https://api.github.com/users/dimitarsh1","html_url":"https://github.com/dimitarsh1","followers_url":"https://api.github.com/users/dimitarsh1/followers","following_url":"https://api.github.com/users/dimitarsh1/following{/other_user}","gists_url":"https://api.github.com/users/dimitarsh1/gists{/gist_id}","starred_url":"https://api.github.com/users/dimitarsh1/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dimitarsh1/subscriptions","organizations_url":"https://api.github.com/users/dimitarsh1/orgs","repos_url":"https://api.github.com/users/dimitarsh1/repos","events_url":"https://api.github.com/users/dimitarsh1/events{/privacy}","received_events_url":"https://api.github.com/users/dimitarsh1/received_events","type":"User","site_admin":false},"created_at":"2018-12-31T12:30:13Z","updated_at":"2018-12-31T12:30:13Z","author_association":"NONE","body":"Please ignore this error. I updated the nvidia driver and now it works fine. \r\n\r\nCheers, \r\nDimitar"}}
{"actor":{"display_login":"dimitarsh1"}}