{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/models/issues/4241","repository_url":"https://api.github.com/repos/tensorflow/models","labels_url":"https://api.github.com/repos/tensorflow/models/issues/4241/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/models/issues/4241/comments","events_url":"https://api.github.com/repos/tensorflow/models/issues/4241/events","html_url":"https://github.com/tensorflow/models/issues/4241","id":322311680,"number":4241,"title":"INFO:tensorflow:Caught OutOfRangeError. Stopping Training. FIFOQueue '_2_prefetch_queue' is closed and has insufficient elements","user":{"login":"rohit789123","id":8696604,"avatar_url":"https://avatars3.githubusercontent.com/u/8696604?v=4","gravatar_id":"","url":"https://api.github.com/users/rohit789123","html_url":"https://github.com/rohit789123","followers_url":"https://api.github.com/users/rohit789123/followers","following_url":"https://api.github.com/users/rohit789123/following{/other_user}","gists_url":"https://api.github.com/users/rohit789123/gists{/gist_id}","starred_url":"https://api.github.com/users/rohit789123/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rohit789123/subscriptions","organizations_url":"https://api.github.com/users/rohit789123/orgs","repos_url":"https://api.github.com/users/rohit789123/repos","events_url":"https://api.github.com/users/rohit789123/events{/privacy}","received_events_url":"https://api.github.com/users/rohit789123/received_events","type":"User","site_admin":false},"labels":[{"id":387356495,"url":"https://api.github.com/repos/tensorflow/models/labels/stat:awaiting%20response","name":"stat:awaiting response","color":"5319e7","default":false}],"state":"closed","locked":false,"assignee":{"login":"nealwu","id":726075,"avatar_url":"https://avatars3.githubusercontent.com/u/726075?v=4","gravatar_id":"","url":"https://api.github.com/users/nealwu","html_url":"https://github.com/nealwu","followers_url":"https://api.github.com/users/nealwu/followers","following_url":"https://api.github.com/users/nealwu/following{/other_user}","gists_url":"https://api.github.com/users/nealwu/gists{/gist_id}","starred_url":"https://api.github.com/users/nealwu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nealwu/subscriptions","organizations_url":"https://api.github.com/users/nealwu/orgs","repos_url":"https://api.github.com/users/nealwu/repos","events_url":"https://api.github.com/users/nealwu/events{/privacy}","received_events_url":"https://api.github.com/users/nealwu/received_events","type":"User","site_admin":false},"assignees":[{"login":"nealwu","id":726075,"avatar_url":"https://avatars3.githubusercontent.com/u/726075?v=4","gravatar_id":"","url":"https://api.github.com/users/nealwu","html_url":"https://github.com/nealwu","followers_url":"https://api.github.com/users/nealwu/followers","following_url":"https://api.github.com/users/nealwu/following{/other_user}","gists_url":"https://api.github.com/users/nealwu/gists{/gist_id}","starred_url":"https://api.github.com/users/nealwu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nealwu/subscriptions","organizations_url":"https://api.github.com/users/nealwu/orgs","repos_url":"https://api.github.com/users/nealwu/repos","events_url":"https://api.github.com/users/nealwu/events{/privacy}","received_events_url":"https://api.github.com/users/nealwu/received_events","type":"User","site_admin":false}],"milestone":null,"comments":1,"created_at":"2018-05-11T14:11:35Z","updated_at":"2018-05-22T13:20:35Z","closed_at":"2018-05-22T13:20:35Z","author_association":"NONE","body":"I am trying to run ssd_mobilenet_v2 using google object detection api. I am using python3.5 , tensorflow 1.7.0 (virtualenv) but encountering the following error:\r\n\r\nINFO:tensorflow:Caught OutOfRangeError. Stopping Training. FIFOQueue '_2_prefetch_queue' is closed and has insufficient elements (requested 1, current size 0)\r\n\t [[Node: prefetch_queue_Dequeue = QueueDequeueV2[component_types=[DT_FLOAT, DT_INT64, DT_INT32, DT_INT32, DT_INT32, ..., DT_INT64, DT_INT32, DT_STRING, DT_STRING, DT_INT32], timeout_ms=-1, _device=\"/job:localhost/replica:0/task:0/device:CPU:0\"](prefetch_queue)]]\r\n\t [[Node: BoxPredictor_3/BoxEncodingPredictor/biases/read/_1863 = _Recv[client_terminated=false, recv_device=\"/job:localhost/replica:0/task:0/device:GPU:0\", send_device=\"/job:localhost/replica:0/task:0/device:CPU:0\", send_device_incarnation=1, tensor_name=\"edge_4212_BoxPredictor_3/BoxEncodingPredictor/biases/read\", tensor_type=DT_FLOAT, _device=\"/job:localhost/replica:0/task:0/device:GPU:0\"]()]]\r\n\r\nCaused by op 'prefetch_queue_Dequeue', defined at:\r\n  File \"object_detection/train.py\", line 167, in <module>\r\n    tf.app.run()\r\n  File \"/usr/local/lib/python3.5/dist-packages/tensorflow/python/platform/app.py\", line 126, in run\r\n    _sys.exit(main(argv))\r\n  File \"object_detection/train.py\", line 163, in main\r\n    worker_job_name, is_chief, FLAGS.train_dir)\r\n  File \"/opt/models/research/object_detection/trainer.py\", line 246, in train\r\n    clones = model_deploy.create_clones(deploy_config, model_fn, [input_queue])\r\n  File \"/opt/models/research/slim/deployment/model_deploy.py\", line 193, in create_clones\r\n    outputs = model_fn(*args, **kwargs)\r\n  File \"/opt/models/research/object_detection/trainer.py\", line 158, in _create_losses\r\n    train_config.merge_multiple_label_boxes)\r\n  File \"/opt/models/research/object_detection/trainer.py\", line 114, in get_inputs\r\n    read_data_list = input_queue.dequeue()\r\n  File \"/opt/models/research/object_detection/core/batcher.py\", line 111, in dequeue\r\n    batched_tensors = self._queue.dequeue()\r\n  File \"/usr/local/lib/python3.5/dist-packages/tensorflow/python/ops/data_flow_ops.py\", line 440, in dequeue\r\n    self._queue_ref, self._dtypes, name=name)\r\n  File \"/usr/local/lib/python3.5/dist-packages/tensorflow/python/ops/gen_data_flow_ops.py\", line 3730, in queue_dequeue_v2\r\n    timeout_ms=timeout_ms, name=name)\r\n  File \"/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/op_def_library.py\", line 787, in _apply_op_helper\r\n    op_def=op_def)\r\n  File \"/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/ops.py\", line 3290, in create_op\r\n    op_def=op_def)\r\n  File \"/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/ops.py\", line 1654, in __init__\r\n    self._traceback = self._graph._extract_stack()  # pylint: disable=protected-access\r\n\r\n\r\nbelow is the config file:\r\n\r\n[ssd_mobilenetv2_config.txt](https://github.com/tensorflow/models/files/1995581/ssd_mobilenetv2_config.txt)\r\n\r\nHow can I overcome this error.\r\n\r\nFollowing are the specifications:\r\n- **Have I written custom code (as opposed to using a stock example script provided in TensorFlow)**:\r\n     No\r\n- **OS Platform and Distribution (e.g., Linux Ubuntu 16.04)**:\r\n    Ubuntu 16.04\r\n- **TensorFlow installed from (source or binary)**:\r\n    Binary\r\n- **TensorFlow version (use command below)**:\r\n    1.7.0\r\n- **Bazel version (if compiling from source)**:\r\n    No\r\n- **CUDA/cuDNN version**:\r\n   cuda 9.0\r\n- **GPU model and memory**:\r\n   GTX 1080 Ti\r\n- **Exact command to reproduce**:\r\n    python object_detection/train.py --pipeline_config_path=path/to/config/file   --train_dir=path/to/directory\r\n\r\nThanks\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/tensorflow/models/issues/comments/390987132","html_url":"https://github.com/tensorflow/models/issues/4241#issuecomment-390987132","issue_url":"https://api.github.com/repos/tensorflow/models/issues/4241","id":390987132,"user":{"login":"rohit789123","id":8696604,"avatar_url":"https://avatars3.githubusercontent.com/u/8696604?v=4","gravatar_id":"","url":"https://api.github.com/users/rohit789123","html_url":"https://github.com/rohit789123","followers_url":"https://api.github.com/users/rohit789123/followers","following_url":"https://api.github.com/users/rohit789123/following{/other_user}","gists_url":"https://api.github.com/users/rohit789123/gists{/gist_id}","starred_url":"https://api.github.com/users/rohit789123/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rohit789123/subscriptions","organizations_url":"https://api.github.com/users/rohit789123/orgs","repos_url":"https://api.github.com/users/rohit789123/repos","events_url":"https://api.github.com/users/rohit789123/events{/privacy}","received_events_url":"https://api.github.com/users/rohit789123/received_events","type":"User","site_admin":false},"created_at":"2018-05-22T13:20:35Z","updated_at":"2018-05-22T13:20:35Z","author_association":"NONE","body":"My bad ... actually there was a mismatch between no of classes in the config file and no of classes present in the dataset"}}
{"actor":{"display_login":"rohit789123"}}