{"action":"created","issue":{"url":"https://api.github.com/repos/qqwweee/keras-yolo3/issues/119","repository_url":"https://api.github.com/repos/qqwweee/keras-yolo3","labels_url":"https://api.github.com/repos/qqwweee/keras-yolo3/issues/119/labels{/name}","comments_url":"https://api.github.com/repos/qqwweee/keras-yolo3/issues/119/comments","events_url":"https://api.github.com/repos/qqwweee/keras-yolo3/issues/119/events","html_url":"https://github.com/qqwweee/keras-yolo3/issues/119","id":333249405,"node_id":"MDU6SXNzdWUzMzMyNDk0MDU=","number":119,"title":"Problem during training my own model, val loss=nan with RuntimeWarning","user":{"login":"franklu323","id":28680833,"node_id":"MDQ6VXNlcjI4NjgwODMz","avatar_url":"https://avatars0.githubusercontent.com/u/28680833?v=4","gravatar_id":"","url":"https://api.github.com/users/franklu323","html_url":"https://github.com/franklu323","followers_url":"https://api.github.com/users/franklu323/followers","following_url":"https://api.github.com/users/franklu323/following{/other_user}","gists_url":"https://api.github.com/users/franklu323/gists{/gist_id}","starred_url":"https://api.github.com/users/franklu323/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/franklu323/subscriptions","organizations_url":"https://api.github.com/users/franklu323/orgs","repos_url":"https://api.github.com/users/franklu323/repos","events_url":"https://api.github.com/users/franklu323/events{/privacy}","received_events_url":"https://api.github.com/users/franklu323/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2018-06-18T12:31:17Z","updated_at":"2018-12-14T08:13:03Z","closed_at":null,"author_association":"NONE","body":"Hi, I got some issue during training my own model.\r\nI only have 1 class and I already change cfg file class=1 and filters=18. And I convert it to h5 file.\r\nBut during the training process, validation loss remains NaN (for both old version/new version codes). It works fine before and I didn't change any of these codes.\r\n![1](https://user-images.githubusercontent.com/28680833/41535172-778fd6ce-7355-11e8-8181-2cd49721f2ef.PNG)\r\nThis is on the new version of the codes, it works with RuntimeWarning when training, and it won't stop before 50 epochs. Just stopped during fine-tune (out of memory). \r\n![2](https://user-images.githubusercontent.com/28680833/41535633-1c9faba2-7357-11e8-93b7-6b81995b2e32.PNG)\r\nThis is on the previous version of the codes, and it stopped before 10 epochs (early stop) with NaN on validation loss.\r\n\r\nCan anyone help me with this problem? I convert weights by using 'python convert.py -w yolov3.cfg yolov3.weights model_data/yolo_weights.h5'. And I change all relevant class number and filters before training. Thanks\r\n"},"comment":{"url":"https://api.github.com/repos/qqwweee/keras-yolo3/issues/comments/447248851","html_url":"https://github.com/qqwweee/keras-yolo3/issues/119#issuecomment-447248851","issue_url":"https://api.github.com/repos/qqwweee/keras-yolo3/issues/119","id":447248851,"node_id":"MDEyOklzc3VlQ29tbWVudDQ0NzI0ODg1MQ==","user":{"login":"hxy1051653358","id":43035276,"node_id":"MDQ6VXNlcjQzMDM1Mjc2","avatar_url":"https://avatars2.githubusercontent.com/u/43035276?v=4","gravatar_id":"","url":"https://api.github.com/users/hxy1051653358","html_url":"https://github.com/hxy1051653358","followers_url":"https://api.github.com/users/hxy1051653358/followers","following_url":"https://api.github.com/users/hxy1051653358/following{/other_user}","gists_url":"https://api.github.com/users/hxy1051653358/gists{/gist_id}","starred_url":"https://api.github.com/users/hxy1051653358/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hxy1051653358/subscriptions","organizations_url":"https://api.github.com/users/hxy1051653358/orgs","repos_url":"https://api.github.com/users/hxy1051653358/repos","events_url":"https://api.github.com/users/hxy1051653358/events{/privacy}","received_events_url":"https://api.github.com/users/hxy1051653358/received_events","type":"User","site_admin":false},"created_at":"2018-12-14T08:13:03Z","updated_at":"2018-12-14T08:13:03Z","author_association":"NONE","body":"@JingangLang I am also getting same error.Did you get it resolved?"}}
{"actor":{"display_login":"hxy1051653358"}}