{"action":"created","issue":{"url":"https://api.github.com/repos/rbgirshick/fast-rcnn/issues/2","repository_url":"https://api.github.com/repos/rbgirshick/fast-rcnn","labels_url":"https://api.github.com/repos/rbgirshick/fast-rcnn/issues/2/labels{/name}","comments_url":"https://api.github.com/repos/rbgirshick/fast-rcnn/issues/2/comments","events_url":"https://api.github.com/repos/rbgirshick/fast-rcnn/issues/2/events","html_url":"https://github.com/rbgirshick/fast-rcnn/issues/2","id":72662161,"number":2,"title":"Out of memory while running demo.py","user":{"login":"markotitel","id":5695612,"avatar_url":"https://avatars.githubusercontent.com/u/5695612?v=3","gravatar_id":"","url":"https://api.github.com/users/markotitel","html_url":"https://github.com/markotitel","followers_url":"https://api.github.com/users/markotitel/followers","following_url":"https://api.github.com/users/markotitel/following{/other_user}","gists_url":"https://api.github.com/users/markotitel/gists{/gist_id}","starred_url":"https://api.github.com/users/markotitel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/markotitel/subscriptions","organizations_url":"https://api.github.com/users/markotitel/orgs","repos_url":"https://api.github.com/users/markotitel/repos","events_url":"https://api.github.com/users/markotitel/events{/privacy}","received_events_url":"https://api.github.com/users/markotitel/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":8,"created_at":"2015-05-02T15:40:25Z","updated_at":"2016-05-24T23:42:55Z","closed_at":"2015-05-02T16:01:52Z","body":"Hello,\r\n\r\nI have found several similar issues with out of memory problem regarding caffe.\r\nI am not sure if my issue is connected to caffe or fast-rcnn tuning.\r\nI have amazon instance, nvidia-smi gives:\r\n```\r\n+------------------------------------------------------+                       \r\n| NVIDIA-SMI 340.29     Driver Version: 340.29         |                       \r\n|-------------------------------+----------------------+----------------------+\r\n| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |\r\n| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |\r\n|===============================+======================+======================|\r\n|   0  GRID K520           Off  | 0000:00:03.0     Off |                  N/A |\r\n| N/A   36C    P0    43W / 125W |     10MiB /  4095MiB |      0%      Default |\r\n+-------------------------------+----------------------+----------------------+\r\n|   1  GRID K520           Off  | 0000:00:04.0     Off |                  N/A |\r\n| N/A   30C    P0    41W / 125W |     10MiB /  4095MiB |      0%      Default |\r\n+-------------------------------+----------------------+----------------------+\r\n|   2  GRID K520           Off  | 0000:00:05.0     Off |                  N/A |\r\n| N/A   38C    P0    44W / 125W |     10MiB /  4095MiB |      0%      Default |\r\n+-------------------------------+----------------------+----------------------+\r\n|   3  GRID K520           Off  | 0000:00:06.0     Off |                  N/A |\r\n| N/A   34C    P0    36W / 125W |     10MiB /  4095MiB |      0%      Default |\r\n+-------------------------------+----------------------+----------------------+\r\n                                                                               \r\n+-----------------------------------------------------------------------------+\r\n| Compute processes:                                               GPU Memory |\r\n|  GPU       PID  Process name                                     Usage      |\r\n|=============================================================================|\r\n|  No running compute processes found                                         |\r\n+-----------------------------------------------------------------------------+\r\n```\r\n\r\nActual error output I get is:\r\n```\r\nI0502 15:34:45.246454 36085 net.cpp:218] Memory required for data: 114633208\r\n[libprotobuf WARNING google/protobuf/io/coded_stream.cc:505] Reading dangerously large protocol message.  If the message turns out to be larger than 2147483647 bytes, parsing will be halted for security reasons.  To increase the limit (or to disable these warnings), see CodedInputStream::SetTotalBytesLimit() in google/protobuf/io/coded_stream.h.\r\n[libprotobuf WARNING google/protobuf/io/coded_stream.cc:78] The total number of bytes read was 538766130\r\n\r\n\r\nLoaded network data/fast_rcnn_models/vgg16_fast_rcnn_iter_40000.caffemodel\r\n\r\nDemo for data/demo/000004.jpg\r\nF0502 15:34:46.777649 36085 syncedmem.cpp:57] Check failed: error == cudaSuccess (2 vs. 0)  out of memory\r\n*** Check failure stack trace: ***\r\n```\r\n\r\nI have found that I have to reduce batch size. I cannot get it in which file to decrease and if that is the only thing neede. O r I have to recompile something afterwards.\r\n\r\nKindly thanks"},"comment":{"url":"https://api.github.com/repos/rbgirshick/fast-rcnn/issues/comments/221434538","html_url":"https://github.com/rbgirshick/fast-rcnn/issues/2#issuecomment-221434538","issue_url":"https://api.github.com/repos/rbgirshick/fast-rcnn/issues/2","id":221434538,"user":{"login":"aaronpolhamus","id":2927860,"avatar_url":"https://avatars.githubusercontent.com/u/2927860?v=3","gravatar_id":"","url":"https://api.github.com/users/aaronpolhamus","html_url":"https://github.com/aaronpolhamus","followers_url":"https://api.github.com/users/aaronpolhamus/followers","following_url":"https://api.github.com/users/aaronpolhamus/following{/other_user}","gists_url":"https://api.github.com/users/aaronpolhamus/gists{/gist_id}","starred_url":"https://api.github.com/users/aaronpolhamus/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/aaronpolhamus/subscriptions","organizations_url":"https://api.github.com/users/aaronpolhamus/orgs","repos_url":"https://api.github.com/users/aaronpolhamus/repos","events_url":"https://api.github.com/users/aaronpolhamus/events{/privacy}","received_events_url":"https://api.github.com/users/aaronpolhamus/received_events","type":"User","site_admin":false},"created_at":"2016-05-24T23:42:55Z","updated_at":"2016-05-24T23:42:55Z","body":"@bipul21: what't the process for passing caffenet into the demo as a valid option? currently executing your command results in `demo.py: error: argument --net: invalid choice: 'caffenet' (choose from 'vgg16', 'zf')`"}}
{"actor":{"display_login":"aaronpolhamus"}}