{"action":"opened","issue":{"url":"https://api.github.com/repos/sfzhang15/RefineDet/issues/98","repository_url":"https://api.github.com/repos/sfzhang15/RefineDet","labels_url":"https://api.github.com/repos/sfzhang15/RefineDet/issues/98/labels{/name}","comments_url":"https://api.github.com/repos/sfzhang15/RefineDet/issues/98/comments","events_url":"https://api.github.com/repos/sfzhang15/RefineDet/issues/98/events","html_url":"https://github.com/sfzhang15/RefineDet/issues/98","id":344768797,"node_id":"MDU6SXNzdWUzNDQ3Njg3OTc=","number":98,"title":"loss = nan / 0","user":{"login":"Arthur-Shi","id":25749209,"node_id":"MDQ6VXNlcjI1NzQ5MjA5","avatar_url":"https://avatars3.githubusercontent.com/u/25749209?v=4","gravatar_id":"","url":"https://api.github.com/users/Arthur-Shi","html_url":"https://github.com/Arthur-Shi","followers_url":"https://api.github.com/users/Arthur-Shi/followers","following_url":"https://api.github.com/users/Arthur-Shi/following{/other_user}","gists_url":"https://api.github.com/users/Arthur-Shi/gists{/gist_id}","starred_url":"https://api.github.com/users/Arthur-Shi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Arthur-Shi/subscriptions","organizations_url":"https://api.github.com/users/Arthur-Shi/orgs","repos_url":"https://api.github.com/users/Arthur-Shi/repos","events_url":"https://api.github.com/users/Arthur-Shi/events{/privacy}","received_events_url":"https://api.github.com/users/Arthur-Shi/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-07-26T09:37:49Z","updated_at":"2018-07-26T09:37:49Z","closed_at":null,"author_association":"NONE","body":"I followed the READ.md to convert VOC2007 into lmdb datasets. But I cannot open the mdb files by access and excel, is it right?\r\n\r\nAnd During my training, the losses are nan/0.\r\n\r\nIteration 0, loss = 26.9579\r\nI0726 17:36:25.590222  6123 solver.cpp:259]     Train net output #0: arm_loss = 9.57847 (* 1 = 9.57847 loss)\r\nI0726 17:36:25.590236  6123 solver.cpp:259]     Train net output #1: odm_loss = 17.3795 (* 1 = 17.3795 loss)\r\nI0726 17:36:25.590265  6123 sgd_solver.cpp:138] Iteration 0, lr = 0.001\r\nI0726 17:36:30.275578  6123 solver.cpp:243] Iteration 10, loss = 19.514\r\nI0726 17:36:30.275650  6123 solver.cpp:259]     Train net output #0: arm_loss = 6.04442 (* 1 = 6.04442 loss)\r\nI0726 17:36:30.275662  6123 solver.cpp:259]     Train net output #1: odm_loss = 15.4255 (* 1 = 15.4255 loss)\r\nI0726 17:36:30.275673  6123 sgd_solver.cpp:138] Iteration 10, lr = 0.001\r\nI0726 17:36:35.329936  6123 solver.cpp:243] Iteration 20, loss = nan\r\nI0726 17:36:35.330014  6123 solver.cpp:259]     Train net output #0: arm_loss = nan (* 1 = nan loss)\r\nI0726 17:36:35.330031  6123 solver.cpp:259]     Train net output #1: odm_loss = 0 (* 1 = 0 loss)\r\nI0726 17:36:35.330044  6123 sgd_solver.cpp:138] Iteration 20, lr = 0.001\r\nI0726 17:36:40.332947  6123 solver.cpp:243] Iteration 30, loss = nan\r\nI0726 17:36:40.333024  6123 solver.cpp:259]     Train net output #0: arm_loss = nan (* 1 = nan loss)\r\nI0726 17:36:40.333043  6123 solver.cpp:259]     Train net output #1: odm_loss = 0 (* 1 = 0 loss)\r\nI0726 17:36:40.333058  6123 sgd_solver.cpp:138] Iteration 30, lr = 0.001\r\nI0726 17:36:45.324910  6123 solver.cpp:243] Iteration 40, loss = nan\r\nI0726 17:36:45.324980  6123 solver.cpp:259]     Train net output #0: arm_loss = 0 (* 1 = 0 loss)\r\nI0726 17:36:45.324995  6123 solver.cpp:259]     Train net output #1: odm_loss = 0 (* 1 = 0 loss)\r\nI0726 17:36:45.325007  6123 sgd_solver.cpp:138] Iteration 40, lr = 0.001\r\nI0726 17:36:50.343459  6123 solver.cpp:243] Iteration 50, loss = nan\r\nI0726 17:36:50.343544  6123 solver.cpp:259]     Train net output #0: arm_loss = nan (* 1 = nan loss)\r\nI0726 17:36:50.343564  6123 solver.cpp:259]     Train net output #1: odm_loss = 0 (* 1 = 0 loss)\r\nI0726 17:36:50.343580  6123 sgd_solver.cpp:138] Iteration 50, lr = 0.001\r\nI0726 17:36:55.368263  6123 solver.cpp:243] Iteration 60, loss = nan\r\nI0726 17:36:55.368419  6123 solver.cpp:259]     Train net output #0: arm_loss = nan (* 1 = nan loss)\r\nI0726 17:36:55.368448  6123 solver.cpp:259]     Train net output #1: odm_loss = 0 (* 1 = 0 loss)\r\n\r\n\r\nWhy? is it the lmdb problem? "}}
{"actor":{"display_login":"Arthur-Shi"}}