{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/tensor2tensor/issues/1006","repository_url":"https://api.github.com/repos/tensorflow/tensor2tensor","labels_url":"https://api.github.com/repos/tensorflow/tensor2tensor/issues/1006/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/tensor2tensor/issues/1006/comments","events_url":"https://api.github.com/repos/tensorflow/tensor2tensor/issues/1006/events","html_url":"https://github.com/tensorflow/tensor2tensor/issues/1006","id":351829830,"node_id":"MDU6SXNzdWUzNTE4Mjk4MzA=","number":1006,"title":"model: universal_transformer can't working with worker_gpu = 2 ?","user":{"login":"gushuheng","id":38007497,"node_id":"MDQ6VXNlcjM4MDA3NDk3","avatar_url":"https://avatars3.githubusercontent.com/u/38007497?v=4","gravatar_id":"","url":"https://api.github.com/users/gushuheng","html_url":"https://github.com/gushuheng","followers_url":"https://api.github.com/users/gushuheng/followers","following_url":"https://api.github.com/users/gushuheng/following{/other_user}","gists_url":"https://api.github.com/users/gushuheng/gists{/gist_id}","starred_url":"https://api.github.com/users/gushuheng/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gushuheng/subscriptions","organizations_url":"https://api.github.com/users/gushuheng/orgs","repos_url":"https://api.github.com/users/gushuheng/repos","events_url":"https://api.github.com/users/gushuheng/events{/privacy}","received_events_url":"https://api.github.com/users/gushuheng/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-08-18T15:40:56Z","updated_at":"2018-08-22T08:29:59Z","closed_at":null,"author_association":"NONE","body":"### Description\r\nwhen I training using t2t-trainer, and try the universal_transformer together with worker_gpu = 2 , training failed immediately with error and exit (BTW: train default with 1 GPU works). \r\nINFO:tensorflow:Cannot use 'Identity_122' as input to 'Identity_33' because they are in different while loops.\r\nIdentity_122 while context: universal_transformer/parallel_1_5/universal_transformer/universal_transformer/body/encoder/universal_transformer_basic/foldl/while/while_context\r\nIdentity_33 while context: universal_transformer/parallel_0_5/universal_transformer/universal_transformer/body/encoder/universal_transformer_basic/foldl/while/while_context\r\n\r\nTraceback for Identity_122:\r\n.....\r\n\r\n\r\n### Environment information\r\nOS: \r\nLinux 8d9c9f85bad0 4.4.0-131-generic \r\n\r\n$ pip freeze | grep tensor\r\ntensor2tensor==1.7.0\r\ntensorboard==1.9.0\r\ntensorflow==1.9.0\r\n\r\n$ python -V\r\nPython 3.6.5 :: Anaconda, Inc.\r\n\r\n\r\n### For bugs: reproduction and error logs\r\n\r\n```\r\n# Steps to reproduce:\r\nt2t-trainer \\\r\n  --data_dir=$DATA_DIR \\\r\n  --problem=translate_enzh_wmt32k \\\r\n  --model=universal_transformer \\\r\n  --hparams_set=universal_transformer_small \\\r\n  --hparams='batch_size=5120' \\\r\n  --train_steps=800000 \\\r\n  --random_seed=33 \\\r\n  --worker_gpu=2 \\\r\n  --output_dir=$TRAIN_DIR\r\n```\r\n# Error logs:\r\nINFO:tensorflow:Cannot use 'Identity_122' as input to 'Identity_33' because they are in different while loops.\r\nIdentity_122 while context: universal_transformer/parallel_1_5/universal_transformer/universal_transformer/body/encoder/universal_transformer_basic/foldl/while/while_context\r\nIdentity_33 while context: universal_transformer/parallel_0_5/universal_transformer/universal_transformer/body/encoder/universal_transformer_basic/foldl/while/while_context\r\n\r\nTraceback for Identity_122:\r\n.....\r\n"},"comment":{"url":"https://api.github.com/repos/tensorflow/tensor2tensor/issues/comments/414954846","html_url":"https://github.com/tensorflow/tensor2tensor/issues/1006#issuecomment-414954846","issue_url":"https://api.github.com/repos/tensorflow/tensor2tensor/issues/1006","id":414954846,"node_id":"MDEyOklzc3VlQ29tbWVudDQxNDk1NDg0Ng==","user":{"login":"zxqchat","id":12473617,"node_id":"MDQ6VXNlcjEyNDczNjE3","avatar_url":"https://avatars1.githubusercontent.com/u/12473617?v=4","gravatar_id":"","url":"https://api.github.com/users/zxqchat","html_url":"https://github.com/zxqchat","followers_url":"https://api.github.com/users/zxqchat/followers","following_url":"https://api.github.com/users/zxqchat/following{/other_user}","gists_url":"https://api.github.com/users/zxqchat/gists{/gist_id}","starred_url":"https://api.github.com/users/zxqchat/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zxqchat/subscriptions","organizations_url":"https://api.github.com/users/zxqchat/orgs","repos_url":"https://api.github.com/users/zxqchat/repos","events_url":"https://api.github.com/users/zxqchat/events{/privacy}","received_events_url":"https://api.github.com/users/zxqchat/received_events","type":"User","site_admin":false},"created_at":"2018-08-22T08:29:59Z","updated_at":"2018-08-22T08:29:59Z","author_association":"CONTRIBUTOR","body":"Hello, can you tell me when you run the model  universal_transformer ,whether it is run correctly? and can you post your parameters to me ?my tensorflow-gpu version is 1.8,but I can't run it with the default parammeters and report a type error ."}}
{"actor":{"display_login":"zxqchat"}}