{"action":"created","issue":{"url":"https://api.github.com/repos/pytorch/pytorch/issues/4507","repository_url":"https://api.github.com/repos/pytorch/pytorch","labels_url":"https://api.github.com/repos/pytorch/pytorch/issues/4507/labels{/name}","comments_url":"https://api.github.com/repos/pytorch/pytorch/issues/4507/comments","events_url":"https://api.github.com/repos/pytorch/pytorch/issues/4507/events","html_url":"https://github.com/pytorch/pytorch/issues/4507","id":286455331,"number":4507,"title":"RuntimeError: DataLoader worker (pid 23616) is killed by signal: Terminated.","user":{"login":"Jensen-Su","id":17847306,"avatar_url":"https://avatars0.githubusercontent.com/u/17847306?v=4","gravatar_id":"","url":"https://api.github.com/users/Jensen-Su","html_url":"https://github.com/Jensen-Su","followers_url":"https://api.github.com/users/Jensen-Su/followers","following_url":"https://api.github.com/users/Jensen-Su/following{/other_user}","gists_url":"https://api.github.com/users/Jensen-Su/gists{/gist_id}","starred_url":"https://api.github.com/users/Jensen-Su/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Jensen-Su/subscriptions","organizations_url":"https://api.github.com/users/Jensen-Su/orgs","repos_url":"https://api.github.com/users/Jensen-Su/repos","events_url":"https://api.github.com/users/Jensen-Su/events{/privacy}","received_events_url":"https://api.github.com/users/Jensen-Su/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2018-01-06T03:21:29Z","updated_at":"2018-03-21T21:34:28Z","closed_at":"2018-01-29T00:18:18Z","author_association":"NONE","body":"Here is the error info\r\n```PYTHON\r\nTraceback (most recent call last):\r\n  File \"train_multi_task.py\", line 192, in <module>\r\n    experiment(config)\r\n  File \"train_multi_task.py\", line 82, in experiment\r\n    data_list.append(iter_.next())\r\n  File \"/usr/local/lib/python2.7/dist-packages/torch/utils/data/dataloader.py\", line 267, in __next__\r\n    idx, batch = self._get_batch()\r\n  File \"/usr/local/lib/python2.7/dist-packages/torch/utils/data/dataloader.py\", line 246, in _get_batch\r\n    return self.data_queue.get()\r\n  File \"/usr/lib/python2.7/multiprocessing/queues.py\", line 376, in get\r\n    return recv()\r\n  File \"/usr/local/lib/python2.7/dist-packages/torch/multiprocessing/queue.py\", line 22, in recv\r\n    return pickle.loads(buf)\r\n  File \"/usr/lib/python2.7/pickle.py\", line 1382, in loads\r\n    return Unpickler(file).load()\r\n  File \"/usr/lib/python2.7/pickle.py\", line 858, in load\r\n    dispatch[key](self)\r\n  File \"/usr/lib/python2.7/pickle.py\", line 1133, in load_reduce\r\n    value = func(*args)\r\n  File \"/usr/local/lib/python2.7/dist-packages/torch/multiprocessing/reductions.py\", line 68, in rebuild_storage_fd\r\n    fd = multiprocessing.reduction.rebuild_handle(df)\r\n  File \"/usr/lib/python2.7/multiprocessing/reduction.py\", line 157, in rebuild_handle\r\n    new_handle = recv_handle(conn)\r\n  File \"/usr/lib/python2.7/multiprocessing/reduction.py\", line 83, in recv_handle\r\n    return _multiprocessing.recvfd(conn.fileno())\r\nOSError: [Errno 4] Interrupted system call\r\nError in atexit._run_exitfuncs:\r\nTraceback (most recent call last):\r\n  File \"/usr/lib/python2.7/atexit.py\", line 24, in _run_exitfuncs\r\n    func(*targs, **kargs)\r\n  File \"/usr/lib/python2.7/multiprocessing/util.py\", line 325, in _exit_function\r\nError in sys.exitfunc:\r\nException RuntimeError: RuntimeError('DataLoader worker (pid 23604) is killed by signal: Terminated.',) in <bound method DataLoaderIter.__del__ of <torch.utils.data.dataloader.DataLoaderIter object at 0x7f73ba2c8850>> ignored\r\nException IOError: IOError(104, 'Connection reset by peer') in <bound method DataLoaderIter.__del__ of <torch.utils.data.dataloader.DataLoaderIter object at 0x7f73ba2c1890>> ignored\r\nTraceback (most recent call last):\r\n  File \"/usr/lib/python2.7/atexit.py\", line 30, in _run_exitfuncs\r\n    traceback.print_exc()\r\n  File \"/usr/lib/python2.7/traceback.py\", line 233, in print_exc\r\n    print_exception(etype, value, tb, limit, file)\r\n  File \"/usr/lib/python2.7/traceback.py\", line 125, in print_exception\r\n    print_tb(tb, limit, file)\r\n  File \"/usr/lib/python2.7/traceback.py\", line 69, in print_tb\r\n    line = linecache.getline(filename, lineno, f.f_globals)\r\n  File \"/usr/lib/python2.7/linecache.py\", line 14, in getline\r\n    lines = getlines(filename, module_globals)\r\n  File \"/usr/lib/python2.7/linecache.py\", line 40, in getlines\r\n    return updatecache(filename, module_globals)\r\n  File \"/usr/lib/python2.7/linecache.py\", line 133, in updatecache\r\n    lines = fp.readlines()\r\n  File \"/usr/local/lib/python2.7/dist-packages/torch/utils/data/dataloader.py\", line 172, in handler\r\n    _error_if_any_worker_fails()\r\nRuntimeError: DataLoader worker (pid 23616) is killed by signal: Terminated.\r\n```\r\nI'm lost..."},"comment":{"url":"https://api.github.com/repos/pytorch/pytorch/issues/comments/375103578","html_url":"https://github.com/pytorch/pytorch/issues/4507#issuecomment-375103578","issue_url":"https://api.github.com/repos/pytorch/pytorch/issues/4507","id":375103578,"user":{"login":"shirishr","id":7770013,"avatar_url":"https://avatars1.githubusercontent.com/u/7770013?v=4","gravatar_id":"","url":"https://api.github.com/users/shirishr","html_url":"https://github.com/shirishr","followers_url":"https://api.github.com/users/shirishr/followers","following_url":"https://api.github.com/users/shirishr/following{/other_user}","gists_url":"https://api.github.com/users/shirishr/gists{/gist_id}","starred_url":"https://api.github.com/users/shirishr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/shirishr/subscriptions","organizations_url":"https://api.github.com/users/shirishr/orgs","repos_url":"https://api.github.com/users/shirishr/repos","events_url":"https://api.github.com/users/shirishr/events{/privacy}","received_events_url":"https://api.github.com/users/shirishr/received_events","type":"User","site_admin":false},"created_at":"2018-03-21T21:34:28Z","updated_at":"2018-03-21T21:34:28Z","author_association":"NONE","body":"I too got this error below, but I am on Python 3.6, would that be the cause?\r\nRuntimeError: DataLoader worker (pid 8591) is killed by signal: Illegal instruction.\r\n\r\nTrace reproduced below:\r\nTraceback (most recent call last):\r\n  File \"train.py\", line 22, in <module>\r\n    for i, data in enumerate(dataset):\r\n  File \"/home/sam/Documents/ComputerVision/pytorch-CycleGAN-and-pix2pix/data/custom_dataset_data_loader.py\", line 44, in __iter__\r\n    for i, data in enumerate(self.dataloader):\r\n  File \"/home/sam/py36/lib/python3.6/site-packages/torch/utils/data/dataloader.py\", line 275, in __next__\r\n    idx, batch = self._get_batch()\r\n  File \"/home/sam/py36/lib/python3.6/site-packages/torch/utils/data/dataloader.py\", line 254, in _get_batch\r\n    return self.data_queue.get()\r\n  File \"/usr/lib/python3.6/multiprocessing/queues.py\", line 335, in get\r\n    res = self._reader.recv_bytes()\r\n  File \"/usr/lib/python3.6/multiprocessing/connection.py\", line 216, in recv_bytes\r\n    buf = self._recv_bytes(maxlength)\r\n  File \"/usr/lib/python3.6/multiprocessing/connection.py\", line 407, in _recv_bytes\r\n    buf = self._recv(4)\r\n  File \"/usr/lib/python3.6/multiprocessing/connection.py\", line 379, in _recv\r\n    chunk = read(handle, remaining)\r\n  File \"/home/sam/py36/lib/python3.6/site-packages/torch/utils/data/dataloader.py\", line 175, in handler\r\n    _error_if_any_worker_fails()\r\nRuntimeError: DataLoader worker (pid 8591) is killed by signal: Illegal instruction.\r\n"}}
{"actor":{"display_login":"shirishr"}}