{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/tensorflow/issues/1450","repository_url":"https://api.github.com/repos/tensorflow/tensorflow","labels_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/1450/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/1450/comments","events_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/1450/events","html_url":"https://github.com/tensorflow/tensorflow/issues/1450","id":139812560,"number":1450,"title":" GPU sync failed","user":{"login":"Duum","id":8976039,"avatar_url":"https://avatars.githubusercontent.com/u/8976039?v=3","gravatar_id":"","url":"https://api.github.com/users/Duum","html_url":"https://github.com/Duum","followers_url":"https://api.github.com/users/Duum/followers","following_url":"https://api.github.com/users/Duum/following{/other_user}","gists_url":"https://api.github.com/users/Duum/gists{/gist_id}","starred_url":"https://api.github.com/users/Duum/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Duum/subscriptions","organizations_url":"https://api.github.com/users/Duum/orgs","repos_url":"https://api.github.com/users/Duum/repos","events_url":"https://api.github.com/users/Duum/events{/privacy}","received_events_url":"https://api.github.com/users/Duum/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/tensorflow/tensorflow/labels/awaiting%20googler","name":"awaiting googler","color":"b60205"},{"url":"https://api.github.com/repos/tensorflow/tensorflow/labels/cuda","name":"cuda","color":"f7c6c7"}],"state":"open","locked":false,"assignee":{"login":"vrv","id":463737,"avatar_url":"https://avatars.githubusercontent.com/u/463737?v=3","gravatar_id":"","url":"https://api.github.com/users/vrv","html_url":"https://github.com/vrv","followers_url":"https://api.github.com/users/vrv/followers","following_url":"https://api.github.com/users/vrv/following{/other_user}","gists_url":"https://api.github.com/users/vrv/gists{/gist_id}","starred_url":"https://api.github.com/users/vrv/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vrv/subscriptions","organizations_url":"https://api.github.com/users/vrv/orgs","repos_url":"https://api.github.com/users/vrv/repos","events_url":"https://api.github.com/users/vrv/events{/privacy}","received_events_url":"https://api.github.com/users/vrv/received_events","type":"User","site_admin":false},"assignees":[{"login":"vrv","id":463737,"avatar_url":"https://avatars.githubusercontent.com/u/463737?v=3","gravatar_id":"","url":"https://api.github.com/users/vrv","html_url":"https://github.com/vrv","followers_url":"https://api.github.com/users/vrv/followers","following_url":"https://api.github.com/users/vrv/following{/other_user}","gists_url":"https://api.github.com/users/vrv/gists{/gist_id}","starred_url":"https://api.github.com/users/vrv/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vrv/subscriptions","organizations_url":"https://api.github.com/users/vrv/orgs","repos_url":"https://api.github.com/users/vrv/repos","events_url":"https://api.github.com/users/vrv/events{/privacy}","received_events_url":"https://api.github.com/users/vrv/received_events","type":"User","site_admin":false}],"milestone":null,"comments":15,"created_at":"2016-03-10T07:44:09Z","updated_at":"2016-09-26T19:13:35Z","closed_at":null,"body":"```\r\n`I` tensorflow/core/common_runtime/gpu/gpu_init.cc:126] DMA: 0 \r\nI tensorflow/core/common_runtime/gpu/gpu_init.cc:136] 0:   Y \r\nI tensorflow/core/common_runtime/gpu/gpu_device.cc:755] Creating TensorFlow device (/gpu:0) -> (device: 0, name: GeForce GTX 970, pci bus id: 0000:01:00.0)\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 256B\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 512B\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 1.0KiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 2.0KiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 4.0KiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 8.0KiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 16.0KiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 32.0KiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 64.0KiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 128.0KiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 256.0KiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 512.0KiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 1.00MiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 2.00MiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 4.00MiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 8.00MiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 16.00MiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 32.00MiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 64.00MiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 128.00MiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:53] Creating bin of max chunk size 256.00MiB\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:107] Allocating 3.51GiB bytes.\r\nI tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:118] GPU 0 memory begins at 0x503dc0000 extends to 0x5e45e3000\r\nE tensorflow/stream_executor/cuda/cuda_driver.cc:1099] could not synchronize on CUDA context: CUDA_ERROR_ILLEGAL_ADDRESS :: No stack trace available\r\nF tensorflow/core/common_runtime/gpu/gpu_util.cc:370] GPU sync failed\r\n```\r\n\r\n\r\nhi!\r\nwhat's wrong with this, how i can solve this.I'm using cuda7.5 cudnn7.0 and all they are ok running on CPU. but when run GPU ,it occur wrong.\r\nAnd I can local the operation which can't run on GPU\r\n```\r\nwith tf.device(\"/cpu:0\"):\r\n optimizer = tf.train.AdamOptimizer(learning_rate=learning_rate).minimize(cost)\r\n```\r\nwhen i remvoe \"tf.device(\"/cpu:0\"),it ocure the bug reported above"},"comment":{"url":"https://api.github.com/repos/tensorflow/tensorflow/issues/comments/249668154","html_url":"https://github.com/tensorflow/tensorflow/issues/1450#issuecomment-249668154","issue_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/1450","id":249668154,"user":{"login":"yash0307","id":6428817,"avatar_url":"https://avatars.githubusercontent.com/u/6428817?v=3","gravatar_id":"","url":"https://api.github.com/users/yash0307","html_url":"https://github.com/yash0307","followers_url":"https://api.github.com/users/yash0307/followers","following_url":"https://api.github.com/users/yash0307/following{/other_user}","gists_url":"https://api.github.com/users/yash0307/gists{/gist_id}","starred_url":"https://api.github.com/users/yash0307/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yash0307/subscriptions","organizations_url":"https://api.github.com/users/yash0307/orgs","repos_url":"https://api.github.com/users/yash0307/repos","events_url":"https://api.github.com/users/yash0307/events{/privacy}","received_events_url":"https://api.github.com/users/yash0307/received_events","type":"User","site_admin":false},"created_at":"2016-09-26T19:13:35Z","updated_at":"2016-09-26T19:13:35Z","body":"```\r\nE tensorflow/stream_executor/cuda/cuda_driver.cc:1140] could not synchronize on CUDA context: CUDA_ERROR_ILLEGAL_ADDRESS :: No stack trace available\r\nE tensorflow/stream_executor/cuda/cuda_event.cc:49] Error polling for event status: failed to query event: CUDA_ERROR_ILLEGAL_ADDRESS\r\nF tensorflow/core/common_runtime/gpu/gpu_event_mgr.cc:198] Unexpected Event status: 1\r\nF tensorflow/core/common_runtime/gpu/gpu_util.cc:370] GPU sync failed\r\nAborted (core dumped)\r\n```"}}
{"actor":{"display_login":"yash0307"}}