{"action":"created","issue":{"url":"https://api.github.com/repos/NVIDIA/nvidia-docker/issues/183","repository_url":"https://api.github.com/repos/NVIDIA/nvidia-docker","labels_url":"https://api.github.com/repos/NVIDIA/nvidia-docker/issues/183/labels{/name}","comments_url":"https://api.github.com/repos/NVIDIA/nvidia-docker/issues/183/comments","events_url":"https://api.github.com/repos/NVIDIA/nvidia-docker/issues/183/events","html_url":"https://github.com/NVIDIA/nvidia-docker/issues/183","id":173512038,"number":183,"title":"nvidia driver update may cause issues","user":{"login":"samitbasu","id":5354222,"avatar_url":"https://avatars.githubusercontent.com/u/5354222?v=3","gravatar_id":"","url":"https://api.github.com/users/samitbasu","html_url":"https://github.com/samitbasu","followers_url":"https://api.github.com/users/samitbasu/followers","following_url":"https://api.github.com/users/samitbasu/following{/other_user}","gists_url":"https://api.github.com/users/samitbasu/gists{/gist_id}","starred_url":"https://api.github.com/users/samitbasu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/samitbasu/subscriptions","organizations_url":"https://api.github.com/users/samitbasu/orgs","repos_url":"https://api.github.com/users/samitbasu/repos","events_url":"https://api.github.com/users/samitbasu/events{/privacy}","received_events_url":"https://api.github.com/users/samitbasu/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2016-08-26T18:14:51Z","updated_at":"2016-09-13T06:58:19Z","closed_at":null,"body":"I believe that an update of the nvidia drivers caused issues with the nvidia-docker plugin.  After the drivers updated, any attempt to launch an nvidia-docker command lead to the following:\r\n\r\n[sbasu@iceman docker]$ nvidia-docker-plugin \r\nnvidia-docker-plugin | 2016/08/26 10:54:38 Loading NVIDIA unified memory\r\nnvidia-docker-plugin | 2016/08/26 10:54:38 Loading NVIDIA management library\r\nfatal error: unexpected signal during runtime execution\r\n[signal 0xb code=0x1 addr=0x0 pc=0x0]\r\n\r\nruntime stack:\r\nruntime.throw(0x9386a0, 0x2a)\r\n\t/usr/local/go/src/runtime/panic.go:527 +0x90\r\nruntime.sigpanic()\r\n\t/usr/local/go/src/runtime/sigpanic_unix.go:12 +0x5a\r\n\r\ngoroutine 1 [syscall, locked to thread]:\r\nruntime.cgocall(0x710b3d, 0xc82006dc20, 0x0)\r\n\t/usr/local/go/src/runtime/cgocall.go:120 +0x11b fp=0xc82006dc00 sp=0xc82006dbd0\r\ngithub.com/NVIDIA/nvidia-docker/tools/src/nvml._Cfunc_nvmlInit_dl(0x0)\r\n\t??:0 +0x3d fp=0xc82006dc20 sp=0xc82006dc00\r\ngithub.com/NVIDIA/nvidia-docker/tools/src/nvml.init_(0x0, 0x0)\r\n\t/go/src/github.com/NVIDIA/nvidia-docker/tools/src/nvml/bindings.go:48 +0x28 fp=0xc82006dc70 sp=0xc82006dc20\r\ngithub.com/NVIDIA/nvidia-docker/tools/src/nvml.Init(0x0, 0x0)\r\n\t/go/src/github.com/NVIDIA/nvidia-docker/tools/src/nvml/nvml.go:134 +0x24 fp=0xc82006dc88 sp=0xc82006dc70\r\ngithub.com/NVIDIA/nvidia-docker/tools/src/nvidia.Init(0x0, 0x0)\r\n\t/go/src/github.com/NVIDIA/nvidia-docker/tools/src/nvidia/nvidia.go:31 +0x118 fp=0xc82006dcf0 sp=0xc82006dc88\r\nmain.main()\r\n\t/go/src/github.com/NVIDIA/nvidia-docker/tools/src/nvidia-docker-plugin/main.go:70 +0x368 fp=0xc82006df50 sp=0xc82006dcf0\r\nruntime.main()\r\n\t/usr/local/go/src/runtime/proc.go:111 +0x2b0 fp=0xc82006dfa0 sp=0xc82006df50\r\nruntime.goexit()\r\n\t/usr/local/go/src/runtime/asm_amd64.s:1721 +0x1 fp=0xc82006dfa8 sp=0xc82006dfa0\r\n\r\ngoroutine 17 [syscall, locked to thread]:\r\nruntime.goexit()\r\n\t/usr/local/go/src/runtime/asm_amd64.s:1721 +0x1\r\n\r\ngoroutine 5 [syscall]:\r\nos/signal.loop()\r\n\t/usr/local/go/src/os/signal/signal_unix.go:22 +0x18\r\ncreated by os/signal.init.1\r\n\t/usr/local/go/src/os/signal/signal_unix.go:28 +0x37\r\n[sbasu@iceman docker]$ \r\n\r\n\r\nWe noticed that the version number of the CUDA driver in /var/lib/nvidia-docker did not match the updated driver version.  Uninstalling the RPM and reinstalling did not work either.  Only uninstalling the RPM, manually deleting the /var/lib/nvidia-docker directory and then reinstalling the RPM seemed to work.\r\n\r\nI guess to reproduce the problem one should try updating the nvidia drivers on a functioning installation and then seeing if the plugin still functions.\r\n"},"comment":{"url":"https://api.github.com/repos/NVIDIA/nvidia-docker/issues/comments/246592503","html_url":"https://github.com/NVIDIA/nvidia-docker/issues/183#issuecomment-246592503","issue_url":"https://api.github.com/repos/NVIDIA/nvidia-docker/issues/183","id":246592503,"user":{"login":"3XX0","id":3028125,"avatar_url":"https://avatars.githubusercontent.com/u/3028125?v=3","gravatar_id":"","url":"https://api.github.com/users/3XX0","html_url":"https://github.com/3XX0","followers_url":"https://api.github.com/users/3XX0/followers","following_url":"https://api.github.com/users/3XX0/following{/other_user}","gists_url":"https://api.github.com/users/3XX0/gists{/gist_id}","starred_url":"https://api.github.com/users/3XX0/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/3XX0/subscriptions","organizations_url":"https://api.github.com/users/3XX0/orgs","repos_url":"https://api.github.com/users/3XX0/repos","events_url":"https://api.github.com/users/3XX0/events{/privacy}","received_events_url":"https://api.github.com/users/3XX0/received_events","type":"User","site_admin":false},"created_at":"2016-09-13T06:58:19Z","updated_at":"2016-09-13T06:58:19Z","body":"Ping?"}}
{"actor":{"display_login":"3XX0"}}