{"action":"created","issue":{"url":"https://api.github.com/repos/rbgirshick/py-faster-rcnn/issues/254","repository_url":"https://api.github.com/repos/rbgirshick/py-faster-rcnn","labels_url":"https://api.github.com/repos/rbgirshick/py-faster-rcnn/issues/254/labels{/name}","comments_url":"https://api.github.com/repos/rbgirshick/py-faster-rcnn/issues/254/comments","events_url":"https://api.github.com/repos/rbgirshick/py-faster-rcnn/issues/254/events","html_url":"https://github.com/rbgirshick/py-faster-rcnn/issues/254","id":165414523,"number":254,"title":"Running training without flipping returns reshape errors.","user":{"login":"duygusar","id":4791974,"avatar_url":"https://avatars.githubusercontent.com/u/4791974?v=3","gravatar_id":"","url":"https://api.github.com/users/duygusar","html_url":"https://github.com/duygusar","followers_url":"https://api.github.com/users/duygusar/followers","following_url":"https://api.github.com/users/duygusar/following{/other_user}","gists_url":"https://api.github.com/users/duygusar/gists{/gist_id}","starred_url":"https://api.github.com/users/duygusar/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/duygusar/subscriptions","organizations_url":"https://api.github.com/users/duygusar/orgs","repos_url":"https://api.github.com/users/duygusar/repos","events_url":"https://api.github.com/users/duygusar/events{/privacy}","received_events_url":"https://api.github.com/users/duygusar/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-07-13T20:31:31Z","updated_at":"2016-07-14T17:42:54Z","closed_at":null,"body":"\r\n\r\nI am having an out of memory problem (details here: https://github.com/rbgirshick/py-faster-rcnn/issues/253) In an attempt to decrease memory usage I have been experimenting, and although I don't think flipped images are hold in the memory or anything (since I have my batchsizes as 1) I am trying whatever might help. Anyway, I have set\r\n\r\n  # Use horizontally-flipped images during training?\r\n__C.TRAIN.USE_FLIPPED = False\r\n\r\nand now I have a great deal of reshape errors. Why is this?\r\n\r\nFile \"./tools/train_net.py\", line 112, in <module>\r\n    max_iters=args.max_iters)\r\n  File \"/home/duygu/py-faster-rcnn/tools/../lib/fast_rcnn/train.py\", line 157, in train_net\r\n    pretrained_model=pretrained_model)\r\n  File \"/home/duygu/py-faster-rcnn/tools/../lib/fast_rcnn/train.py\", line 53, in __init__\r\n    self.solver.net.layers[0].set_roidb(roidb)\r\n  File \"/home/duygu/py-faster-rcnn/tools/../lib/roi_data_layer/layer.py\", line 68, in set_roidb\r\n    self._shuffle_roidb_inds()\r\n  File \"/home/duygu/py-faster-rcnn/tools/../lib/roi_data_layer/layer.py\", line 35, in _shuffle_roidb_inds\r\n    inds = np.reshape(inds, (-1, 2))\r\n  File \"/usr/local/lib/python2.7/dist-packages/numpy/core/fromnumeric.py\", line 225, in reshape\r\n    return reshape(newshape, order=order)\r\nValueError: total size of new array must be unchanged"},"comment":{"url":"https://api.github.com/repos/rbgirshick/py-faster-rcnn/issues/comments/232738303","html_url":"https://github.com/rbgirshick/py-faster-rcnn/issues/254#issuecomment-232738303","issue_url":"https://api.github.com/repos/rbgirshick/py-faster-rcnn/issues/254","id":232738303,"user":{"login":"duygusar","id":4791974,"avatar_url":"https://avatars.githubusercontent.com/u/4791974?v=3","gravatar_id":"","url":"https://api.github.com/users/duygusar","html_url":"https://github.com/duygusar","followers_url":"https://api.github.com/users/duygusar/followers","following_url":"https://api.github.com/users/duygusar/following{/other_user}","gists_url":"https://api.github.com/users/duygusar/gists{/gist_id}","starred_url":"https://api.github.com/users/duygusar/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/duygusar/subscriptions","organizations_url":"https://api.github.com/users/duygusar/orgs","repos_url":"https://api.github.com/users/duygusar/repos","events_url":"https://api.github.com/users/duygusar/events{/privacy}","received_events_url":"https://api.github.com/users/duygusar/received_events","type":"User","site_admin":false},"created_at":"2016-07-14T17:42:54Z","updated_at":"2016-07-14T17:42:54Z","body":"@manipopopo  \r\n\r\nThank you, though I do have an even number of training images in train.txt It should be all valid, I am just running on voc 2007.\r\n\r\nyes, I was not really expecting it to be related to the GPU, I tried setting the batches to 1 only and decreasing no of proposals with no luck so I was just experimenting around. When you crop images, you forward ten images at once (kind of like a 10 image batch) and need that much memory so I thought -maybe- it is the same for flipped images though it might be like mirroring, just doubling the number of images in the dataset. \r\n\r\nI still don't know why it consumes so much memory. I have run the alternative optimization and didn't have a problem. Well true it alternates instead of joint learning but still I think the memory consumption is relatively way too much."}}
{"actor":{"display_login":"duygusar"}}