{"action":"created","issue":{"url":"https://api.github.com/repos/ppwwyyxx/tensorpack/issues/671","repository_url":"https://api.github.com/repos/ppwwyyxx/tensorpack","labels_url":"https://api.github.com/repos/ppwwyyxx/tensorpack/issues/671/labels{/name}","comments_url":"https://api.github.com/repos/ppwwyyxx/tensorpack/issues/671/comments","events_url":"https://api.github.com/repos/ppwwyyxx/tensorpack/issues/671/events","html_url":"https://github.com/ppwwyyxx/tensorpack/issues/671","id":300004325,"number":671,"title":"problem encountered when I conduct distributed training","user":{"login":"anthony123","id":4050099,"avatar_url":"https://avatars3.githubusercontent.com/u/4050099?v=4","gravatar_id":"","url":"https://api.github.com/users/anthony123","html_url":"https://github.com/anthony123","followers_url":"https://api.github.com/users/anthony123/followers","following_url":"https://api.github.com/users/anthony123/following{/other_user}","gists_url":"https://api.github.com/users/anthony123/gists{/gist_id}","starred_url":"https://api.github.com/users/anthony123/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/anthony123/subscriptions","organizations_url":"https://api.github.com/users/anthony123/orgs","repos_url":"https://api.github.com/users/anthony123/repos","events_url":"https://api.github.com/users/anthony123/events{/privacy}","received_events_url":"https://api.github.com/users/anthony123/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2018-02-25T07:02:46Z","updated_at":"2018-02-26T04:33:39Z","closed_at":"2018-02-26T04:32:33Z","author_association":"NONE","body":"I encountered a problem when  i run my distributed training code, the  error traces are as follows:\r\n\r\n![distributederror](https://user-images.githubusercontent.com/4050099/36638940-cee8895c-1a3b-11e8-801d-dafa56cb3390.png)\r\n\r\nmy code is [here](https://github.com/anthony123/learnit/blob/master/cifar10-sparse-densenet-bc-exp.py)\r\n\r\nI launch my code as:\r\n`python cifar10-sparse-densenet-bc-exp.py --gpu=0,1,2,3 --job worker --task 0`\r\n\r\nwhen I use trainer \r\n```\r\ntrainer = SyncMultiGPUTrainerParameterServer(len(args.gpu.split(',')))\r\nlaunch_train_with_config(config, trainer)\r\n```\r\nthere will be no problem\r\n\r\nAny suggestion is appreciated."},"comment":{"url":"https://api.github.com/repos/ppwwyyxx/tensorpack/issues/comments/368387634","html_url":"https://github.com/ppwwyyxx/tensorpack/issues/671#issuecomment-368387634","issue_url":"https://api.github.com/repos/ppwwyyxx/tensorpack/issues/671","id":368387634,"user":{"login":"ppwwyyxx","id":1381301,"avatar_url":"https://avatars3.githubusercontent.com/u/1381301?v=4","gravatar_id":"","url":"https://api.github.com/users/ppwwyyxx","html_url":"https://github.com/ppwwyyxx","followers_url":"https://api.github.com/users/ppwwyyxx/followers","following_url":"https://api.github.com/users/ppwwyyxx/following{/other_user}","gists_url":"https://api.github.com/users/ppwwyyxx/gists{/gist_id}","starred_url":"https://api.github.com/users/ppwwyyxx/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ppwwyyxx/subscriptions","organizations_url":"https://api.github.com/users/ppwwyyxx/orgs","repos_url":"https://api.github.com/users/ppwwyyxx/repos","events_url":"https://api.github.com/users/ppwwyyxx/events{/privacy}","received_events_url":"https://api.github.com/users/ppwwyyxx/received_events","type":"User","site_admin":false},"created_at":"2018-02-26T04:33:39Z","updated_at":"2018-02-26T04:33:39Z","author_association":"OWNER","body":"The above commit should fix the problem. Another way to fix the problem is to upgrade your tensorflow to 1.5"}}
{"actor":{"display_login":"ppwwyyxx"}}