{"action":"created","issue":{"url":"https://api.github.com/repos/uber/horovod/issues/502","repository_url":"https://api.github.com/repos/uber/horovod","labels_url":"https://api.github.com/repos/uber/horovod/issues/502/labels{/name}","comments_url":"https://api.github.com/repos/uber/horovod/issues/502/comments","events_url":"https://api.github.com/repos/uber/horovod/issues/502/events","html_url":"https://github.com/uber/horovod/issues/502","id":361253056,"node_id":"MDU6SXNzdWUzNjEyNTMwNTY=","number":502,"title":"Mentioning multiple gpus, but confused whether it sees multiple or just 1","user":{"login":"UditGupta10","id":18660215,"node_id":"MDQ6VXNlcjE4NjYwMjE1","avatar_url":"https://avatars3.githubusercontent.com/u/18660215?v=4","gravatar_id":"","url":"https://api.github.com/users/UditGupta10","html_url":"https://github.com/UditGupta10","followers_url":"https://api.github.com/users/UditGupta10/followers","following_url":"https://api.github.com/users/UditGupta10/following{/other_user}","gists_url":"https://api.github.com/users/UditGupta10/gists{/gist_id}","starred_url":"https://api.github.com/users/UditGupta10/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/UditGupta10/subscriptions","organizations_url":"https://api.github.com/users/UditGupta10/orgs","repos_url":"https://api.github.com/users/UditGupta10/repos","events_url":"https://api.github.com/users/UditGupta10/events{/privacy}","received_events_url":"https://api.github.com/users/UditGupta10/received_events","type":"User","site_admin":false},"labels":[{"id":665452437,"node_id":"MDU6TGFiZWw2NjU0NTI0Mzc=","url":"https://api.github.com/repos/uber/horovod/labels/question","name":"question","color":"cc317c","default":true}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2018-09-18T11:11:01Z","updated_at":"2018-09-21T15:37:34Z","closed_at":"2018-09-21T15:37:34Z","author_association":"NONE","body":"In the logs it says .../device/GPU:0 in three different cases and after that mentions physical gpu device:1.\r\nDoes it actually use all gpus or spawns different processes on only 1 gpu?\r\nThe logs are below.\r\n\r\n2018-09-18 11:00:04.450576: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 30379 MB memory) -> physical GPU (device: 3, name: Tesla V100-SXM2-32GB, pci bus id: 0000:0b:00.0, compute capability: 7.0)\r\n\r\n2018-09-18 11:00:04.489155: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:\r\n2018-09-18 11:00:04.489197: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      1\r\n2018-09-18 11:00:04.489224: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 1:   N\r\n\r\n2018-09-18 11:00:04.489991: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 30379 MB memory) -> physical GPU (device: 1, name: Tesla V100-SXM2-32GB, pci bus id: 0000:07:00.0, compute capability: 7.0)\r\n\r\n2018-09-18 11:00:04.509637: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:\r\n2018-09-18 11:00:04.509673: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0\r\n2018-09-18 11:00:04.509698: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N\r\n\r\n2018-09-18 11:00:04.510470: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 30379 MB memory) -> physical GPU (device: 0, name: Tesla V100-SXM2-32GB, pci bus id: 0000:06:00.0, compute capability: 7.0)"},"comment":{"url":"https://api.github.com/repos/uber/horovod/issues/comments/423577158","html_url":"https://github.com/uber/horovod/issues/502#issuecomment-423577158","issue_url":"https://api.github.com/repos/uber/horovod/issues/502","id":423577158,"node_id":"MDEyOklzc3VlQ29tbWVudDQyMzU3NzE1OA==","user":{"login":"UditGupta10","id":18660215,"node_id":"MDQ6VXNlcjE4NjYwMjE1","avatar_url":"https://avatars3.githubusercontent.com/u/18660215?v=4","gravatar_id":"","url":"https://api.github.com/users/UditGupta10","html_url":"https://github.com/UditGupta10","followers_url":"https://api.github.com/users/UditGupta10/followers","following_url":"https://api.github.com/users/UditGupta10/following{/other_user}","gists_url":"https://api.github.com/users/UditGupta10/gists{/gist_id}","starred_url":"https://api.github.com/users/UditGupta10/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/UditGupta10/subscriptions","organizations_url":"https://api.github.com/users/UditGupta10/orgs","repos_url":"https://api.github.com/users/UditGupta10/repos","events_url":"https://api.github.com/users/UditGupta10/events{/privacy}","received_events_url":"https://api.github.com/users/UditGupta10/received_events","type":"User","site_admin":false},"created_at":"2018-09-21T15:37:34Z","updated_at":"2018-09-21T15:37:34Z","author_association":"NONE","body":"Thanks."}}
{"actor":{"display_login":"UditGupta10"}}