{"action":"created","issue":{"url":"https://api.github.com/repos/tmcdonell/cuda/issues/55","repository_url":"https://api.github.com/repos/tmcdonell/cuda","labels_url":"https://api.github.com/repos/tmcdonell/cuda/issues/55/labels{/name}","comments_url":"https://api.github.com/repos/tmcdonell/cuda/issues/55/comments","events_url":"https://api.github.com/repos/tmcdonell/cuda/issues/55/events","html_url":"https://github.com/tmcdonell/cuda/issues/55","id":357954427,"node_id":"MDU6SXNzdWUzNTc5NTQ0Mjc=","number":55,"title":"Driver failure on AWS p3.2xlarge instance","user":{"login":"NickHu","id":450276,"node_id":"MDQ6VXNlcjQ1MDI3Ng==","avatar_url":"https://avatars3.githubusercontent.com/u/450276?v=4","gravatar_id":"","url":"https://api.github.com/users/NickHu","html_url":"https://github.com/NickHu","followers_url":"https://api.github.com/users/NickHu/followers","following_url":"https://api.github.com/users/NickHu/following{/other_user}","gists_url":"https://api.github.com/users/NickHu/gists{/gist_id}","starred_url":"https://api.github.com/users/NickHu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/NickHu/subscriptions","organizations_url":"https://api.github.com/users/NickHu/orgs","repos_url":"https://api.github.com/users/NickHu/repos","events_url":"https://api.github.com/users/NickHu/events{/privacy}","received_events_url":"https://api.github.com/users/NickHu/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":9,"created_at":"2018-09-07T07:39:15Z","updated_at":"2018-09-10T06:28:23Z","closed_at":null,"author_association":"NONE","body":"Hi, I'm getting the following error with Haskell `cuda` and also `accelerate-llvm-ptx`:\r\n\r\n```\r\n~ { awscli docker-machine } ❯ docker run --runtime=nvidia -it tmcdonell/accelerate-llvm\r\nroot@7d05fbb8d8d5:/opt/accelerate-llvm# nvidia-smi\r\nFri Sep  7 07:32:48 2018\r\n+-----------------------------------------------------------------------------+\r\n| NVIDIA-SMI 396.44                 Driver Version: 396.44                    |\r\n|-------------------------------+----------------------+----------------------+\r\n| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |\r\n| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |\r\n|===============================+======================+======================|\r\n|   0  Tesla V100-SXM2...  Off  | 00000000:00:1E.0 Off |                    0 |\r\n| N/A   45C    P0    42W / 300W |      0MiB / 16160MiB |      0%      Default |\r\n+-------------------------------+----------------------+----------------------+\r\n+-----------------------------------------------------------------------------+\r\n| Processes:                                                       GPU Memory |\r\n|  GPU       PID   Type   Process name                             Usage      |\r\n|=============================================================================|\r\n|  No running processes found                                                 |\r\n+-----------------------------------------------------------------------------+\r\nroot@7d05fbb8d8d5:/opt/accelerate-llvm# stack install cuda\r\naccelerate-llvm-ptx-1.3.0.0: unregistering (Dependency being unregistered: cuda-0.10.0.0)\r\ncuda-0.10.0.0: unregistering (components added: exe:nvidia-device-query)\r\nnvvm-0.8.0.3: unregistering (Dependency being unregistered: cuda-0.10.0.0)\r\ncuda-0.10.0.0: build (lib + exe)\r\ncuda-0.10.0.0: copy/register\r\nLog files have been written to: /opt/accelerate-llvm/.stack-work/logs/\r\nCopying from /opt/accelerate-llvm/.stack-work/install/x86_64-linux/lts-12.0/8.4.3/bin/nvidia-device-query to /root/.local/bin/nvidia-device-query\r\nCopied executables to /root/.local/bin:\r\n- nvidia-device-query\r\nroot@7d05fbb8d8d5:/opt/accelerate-llvm# nvidia-device-query\r\nnvidia-device-query: Status.toEnum: Cannot match -1\r\nCallStack (from HasCallStack):\r\n  error, called at src/Foreign/CUDA/Driver/Error.chs:372:22 in cuda-0.10.0.0-Lq313TS76CJ6ufZOzm0zPz:Foreign.CUDA.Driver.Error\r\n```\r\n\r\nRelevant information\r\n\r\n```\r\nroot@7d05fbb8d8d5:/opt/accelerate-llvm# echo $CUDA_PKG_VERSION\r\n9-2=9.2.148-1\r\nroot@7d05fbb8d8d5:/opt/accelerate-llvm# echo $CUDA_VERSION\r\n9.2.148\r\nroot@7d05fbb8d8d5:/opt/accelerate-llvm# nvcc --version\r\nnvcc: NVIDIA (R) Cuda compiler driver\r\nCopyright (c) 2005-2018 NVIDIA Corporation\r\nBuilt on Tue_Jun_12_23:07:04_CDT_2018\r\nCuda compilation tools, release 9.2, V9.2.148\r\n```\r\n\r\nThis happens also if I omit `--runtime=nvidia`, and/or use `tmcdonell/accelerate-llvm:stable`, and `nvidia-smi` seems to work fine in Docker so I don't think it's a Docker issue."},"comment":{"url":"https://api.github.com/repos/tmcdonell/cuda/issues/comments/419802547","html_url":"https://github.com/tmcdonell/cuda/issues/55#issuecomment-419802547","issue_url":"https://api.github.com/repos/tmcdonell/cuda/issues/55","id":419802547,"node_id":"MDEyOklzc3VlQ29tbWVudDQxOTgwMjU0Nw==","user":{"login":"NickHu","id":450276,"node_id":"MDQ6VXNlcjQ1MDI3Ng==","avatar_url":"https://avatars3.githubusercontent.com/u/450276?v=4","gravatar_id":"","url":"https://api.github.com/users/NickHu","html_url":"https://github.com/NickHu","followers_url":"https://api.github.com/users/NickHu/followers","following_url":"https://api.github.com/users/NickHu/following{/other_user}","gists_url":"https://api.github.com/users/NickHu/gists{/gist_id}","starred_url":"https://api.github.com/users/NickHu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/NickHu/subscriptions","organizations_url":"https://api.github.com/users/NickHu/orgs","repos_url":"https://api.github.com/users/NickHu/repos","events_url":"https://api.github.com/users/NickHu/events{/privacy}","received_events_url":"https://api.github.com/users/NickHu/received_events","type":"User","site_admin":false},"created_at":"2018-09-10T06:28:23Z","updated_at":"2018-09-10T06:28:23Z","author_association":"NONE","body":"Funnily enough, it also works fine on `nvidia/cuda:9.2-devel-ubuntu16.04` - perhaps this image was generated more recently than `tmcdonell/accelerate-llvm`, and is compatible with the nvidia 396.54 driver. I'll try rebuilding `tmcdonell/accelerate-llvm` and see if it works, but I wonder why this seems so unstable."}}
{"actor":{"display_login":"NickHu"}}