{"action":"opened","issue":{"url":"https://api.github.com/repos/PkuRainBow/OCNet/issues/31","repository_url":"https://api.github.com/repos/PkuRainBow/OCNet","labels_url":"https://api.github.com/repos/PkuRainBow/OCNet/issues/31/labels{/name}","comments_url":"https://api.github.com/repos/PkuRainBow/OCNet/issues/31/comments","events_url":"https://api.github.com/repos/PkuRainBow/OCNet/issues/31/events","html_url":"https://github.com/PkuRainBow/OCNet/issues/31","id":379678974,"node_id":"MDU6SXNzdWUzNzk2Nzg5NzQ=","number":31,"title":"get stuck in Inplace_abn","user":{"login":"tjulyz","id":18508335,"node_id":"MDQ6VXNlcjE4NTA4MzM1","avatar_url":"https://avatars0.githubusercontent.com/u/18508335?v=4","gravatar_id":"","url":"https://api.github.com/users/tjulyz","html_url":"https://github.com/tjulyz","followers_url":"https://api.github.com/users/tjulyz/followers","following_url":"https://api.github.com/users/tjulyz/following{/other_user}","gists_url":"https://api.github.com/users/tjulyz/gists{/gist_id}","starred_url":"https://api.github.com/users/tjulyz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tjulyz/subscriptions","organizations_url":"https://api.github.com/users/tjulyz/orgs","repos_url":"https://api.github.com/users/tjulyz/repos","events_url":"https://api.github.com/users/tjulyz/events{/privacy}","received_events_url":"https://api.github.com/users/tjulyz/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-11-12T09:00:31Z","updated_at":"2018-11-12T09:00:31Z","closed_at":null,"author_association":"NONE","body":"**When I training to train the net, it gets stuck in Inplace abn.\r\nI have tried to build some new environment by conda or using the python of system.\r\nThey don't work! There is not any error information until I stop the program.\r\nAny Solution? \r\nThank you!\r\nUsing python3.6 cuda9.0 pytorch 0.4.1**\r\nTraceback (most recent call last):\r\n  File \"train.py\", line 192, in <module>\r\n    main()\r\n  File \"train.py\", line 168, in main\r\n    preds = model(images)\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/site-packages/torch/nn/modules/module.py\", line 477, in __call__\r\n    result = self.forward(*input, **kwargs)\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/site-packages/torch/nn/parallel/data_parallel.py\", line 123, in forward\r\n    outputs = self.parallel_apply(replicas, inputs, kwargs)\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/site-packages/torch/nn/parallel/data_parallel.py\", line 133, in parallel_apply\r\n    return parallel_apply(replicas, inputs, kwargs, self.device_ids[:len(replicas)])\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/site-packages/torch/nn/parallel/parallel_apply.py\", line 71, in parallel_apply\r\n    _worker(0, modules[0], inputs[0], kwargs_tup[0], devices[0])\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/site-packages/torch/nn/parallel/parallel_apply.py\", line 53, in _worker\r\n    output = module(*input, **kwargs)\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/site-packages/torch/nn/modules/module.py\", line 477, in __call__\r\n    result = self.forward(*input, **kwargs)\r\n  File \"/home/ubuntu/OCNet/network/resnet101_baseline.py\", line 89, in forward\r\nProcess Process-1:\r\n    **x = self.relu1(self.bn1(self.conv1(x)))**\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/site-packages/torch/nn/modules/module.py\", line 477, in __call__\r\n    result = self.forward(*input, **kwargs)\r\n  File \"/home/ubuntu/OCNet/utils/../inplace_abn/bn.py\", line 169, in forward\r\n    extra, self.training, self.momentum, self.eps, self.activation, self.slope)\r\n  File \"/home/ubuntu/OCNet/utils/../inplace_abn/functions.py\", line 163, in forward\r\n    mean_w, var_w = ctx.master_queue.get()\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/queue.py\", line 164, in get\r\n    self.not_empty.wait()\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/threading.py\", line 295, in wait\r\n    waiter.acquire()\r\nKeyboardInterrupt\r\nTraceback (most recent call last):\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/multiprocessing/process.py\", line 258, in _bootstrap\r\n    self.run()\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/multiprocessing/process.py\", line 93, in run\r\n    self._target(*self._args, **self._kwargs)\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/site-packages/torch/utils/data/dataloader.py\", line 96, in _worker_loop\r\n    r = index_queue.get(timeout=MANAGER_STATUS_CHECK_INTERVAL)\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/multiprocessing/queues.py\", line 104, in get\r\n    if not self._poll(timeout):\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/multiprocessing/connection.py\", line 257, in poll\r\n    return self._poll(timeout)\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/multiprocessing/connection.py\", line 414, in _poll\r\n    r = wait([self], timeout)\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/multiprocessing/connection.py\", line 911, in wait\r\n    ready = selector.select(timeout)\r\n  File \"/home/ubuntu/anaconda2/envs/torch/lib/python3.6/selectors.py\", line 376, in select\r\n    fd_event_list = self._poll.poll(timeout)\r\n"}}
{"actor":{"display_login":"tjulyz"}}