{"action":"created","issue":{"url":"https://api.github.com/repos/matterport/Mask_RCNN/issues/213","repository_url":"https://api.github.com/repos/matterport/Mask_RCNN","labels_url":"https://api.github.com/repos/matterport/Mask_RCNN/issues/213/labels{/name}","comments_url":"https://api.github.com/repos/matterport/Mask_RCNN/issues/213/comments","events_url":"https://api.github.com/repos/matterport/Mask_RCNN/issues/213/events","html_url":"https://github.com/matterport/Mask_RCNN/issues/213","id":290755125,"number":213,"title":"Changing backbone's architecture (VGG16, InceptionV3 and ResNeXt) results in NaN losses","user":{"login":"BugaDM","id":6081282,"avatar_url":"https://avatars2.githubusercontent.com/u/6081282?v=4","gravatar_id":"","url":"https://api.github.com/users/BugaDM","html_url":"https://github.com/BugaDM","followers_url":"https://api.github.com/users/BugaDM/followers","following_url":"https://api.github.com/users/BugaDM/following{/other_user}","gists_url":"https://api.github.com/users/BugaDM/gists{/gist_id}","starred_url":"https://api.github.com/users/BugaDM/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/BugaDM/subscriptions","organizations_url":"https://api.github.com/users/BugaDM/orgs","repos_url":"https://api.github.com/users/BugaDM/repos","events_url":"https://api.github.com/users/BugaDM/events{/privacy}","received_events_url":"https://api.github.com/users/BugaDM/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2018-01-23T08:51:17Z","updated_at":"2018-02-12T21:48:44Z","closed_at":"2018-01-23T10:13:04Z","author_association":"NONE","body":"Hi,\r\n\r\nI've trying to replace the ResNet 101 used as backbone with other architectures (e.g. VGG16, Inception V3, ResNeXt 101 or Inception ResNet V2) in order to check whether the results improve or not.\r\n\r\nThe problem is that, whenever I substitute the ResNet with any other architecture, the training losses of the mask branch are NaN or zero:\r\n\r\n`loss: nan - rpn_class_loss: 0.6948 - rpn_bbox_loss: 0.3827 - mrcnn_class_loss: nan - mrcnn_bbox_loss: 0.0000e+00 - mrcnn_mask_loss: 0.0000e+00 - val_loss: nan - val_rpn_class_loss: 0.6931 - val_rpn_bbox_loss: 0.2744 - val_mrcnn_class_loss: nan - val_mrcnn_bbox_loss: 0.0000e+00 - val_mrcnn_mask_loss: 0.0000e+00`\r\n\r\nThese are the implementations I have been using:\r\n\r\n- Inception ResNet V2\r\n- https://gist.github.com/BugaDM/09b1b76d04a570102c966a31f7d37198\r\n\r\n- Inception V3\r\n- https://gist.github.com/BugaDM/aabd048bcb1d7ab26ece4c3499f826e0\r\n\r\n- ResNeXt 101\r\n- https://gist.github.com/BugaDM/f6e3174953f93346b6002d9adc7eb3e5\r\n\r\n- VGG16\r\n- https://gist.github.com/BugaDM/cb70226bed33c0de49b289a8fbd4b667\r\n\r\nI do not get any errors during execution. Any suggestions?"},"comment":{"url":"https://api.github.com/repos/matterport/Mask_RCNN/issues/comments/365073789","html_url":"https://github.com/matterport/Mask_RCNN/issues/213#issuecomment-365073789","issue_url":"https://api.github.com/repos/matterport/Mask_RCNN/issues/213","id":365073789,"user":{"login":"maksimovkonstantin","id":10925437,"avatar_url":"https://avatars2.githubusercontent.com/u/10925437?v=4","gravatar_id":"","url":"https://api.github.com/users/maksimovkonstantin","html_url":"https://github.com/maksimovkonstantin","followers_url":"https://api.github.com/users/maksimovkonstantin/followers","following_url":"https://api.github.com/users/maksimovkonstantin/following{/other_user}","gists_url":"https://api.github.com/users/maksimovkonstantin/gists{/gist_id}","starred_url":"https://api.github.com/users/maksimovkonstantin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/maksimovkonstantin/subscriptions","organizations_url":"https://api.github.com/users/maksimovkonstantin/orgs","repos_url":"https://api.github.com/users/maksimovkonstantin/repos","events_url":"https://api.github.com/users/maksimovkonstantin/events{/privacy}","received_events_url":"https://api.github.com/users/maksimovkonstantin/received_events","type":"User","site_admin":false},"created_at":"2018-02-12T21:48:44Z","updated_at":"2018-02-12T21:48:44Z","author_association":"NONE","body":"@waleedka does that mean that nan in general is caused by wrong prepared data?"}}
{"actor":{"display_login":"maksimovkonstantin"}}