{"action":"created","issue":{"url":"https://api.github.com/repos/BVLC/caffe/issues/4834","repository_url":"https://api.github.com/repos/BVLC/caffe","labels_url":"https://api.github.com/repos/BVLC/caffe/issues/4834/labels{/name}","comments_url":"https://api.github.com/repos/BVLC/caffe/issues/4834/comments","events_url":"https://api.github.com/repos/BVLC/caffe/issues/4834/events","html_url":"https://github.com/BVLC/caffe/issues/4834","id":182461472,"number":4834,"title":"Running Caffe on Titan x Pascal - Windows","user":{"login":"mkyaqub","id":2682873,"avatar_url":"https://avatars.githubusercontent.com/u/2682873?v=3","gravatar_id":"","url":"https://api.github.com/users/mkyaqub","html_url":"https://github.com/mkyaqub","followers_url":"https://api.github.com/users/mkyaqub/followers","following_url":"https://api.github.com/users/mkyaqub/following{/other_user}","gists_url":"https://api.github.com/users/mkyaqub/gists{/gist_id}","starred_url":"https://api.github.com/users/mkyaqub/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mkyaqub/subscriptions","organizations_url":"https://api.github.com/users/mkyaqub/orgs","repos_url":"https://api.github.com/users/mkyaqub/repos","events_url":"https://api.github.com/users/mkyaqub/events{/privacy}","received_events_url":"https://api.github.com/users/mkyaqub/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/BVLC/caffe/labels/windows","name":"windows","color":"bfe5bf"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-10-12T08:10:58Z","updated_at":"2016-10-12T13:28:22Z","closed_at":null,"body":"Hi,\r\nI have been trying to compile Caffe on Windows with the new GPU Titan X Pascal. I have managed to make it compile by using Cuda 7.5, cuDNN 4, Visual studio 2013 and with Python and Matlab support. However, when I try to train a model, I keep getting the following error:\r\n\r\nF1012 08:24:58.364405  6516 math_functions.cu:375] Check failed: status == CURAND_STATUS_SUCCESS (201 vs. 0)  CURAND_STATUS_LAUNCH_FAILURE\r\n\r\nI tried the following and also got the same error:\r\n1- I tried disabling cuDNN and then recompiled Caffe which was fine but when I tried to train a model, I got the same error.\r\n\r\n2- I uninstalled Cuda, then installed installed Cuda 8.0, cuDNN 5.2. I managed to compile Caffe (with and without cuDNN) but again got the same error when I tried to train a model.\r\n\r\n3- I tried to train the same model on a different PC which has Palit NVIDIA GTX TITAN X, Cuda 7.5, cuDNN 4, visual studio 2013, with Python support. Everything was fine and managed to train the same model and got reasonable accuracy on my problem.\r\n\r\n4- I tried to train a model using MatConvNet using the Titan X Pascal and Cuda 8 and it worked fine.\r\n\r\nIf you have any suggestion, please advise. Thanks!\r\n\r\nRegards,"},"comment":{"url":"https://api.github.com/repos/BVLC/caffe/issues/comments/253213069","html_url":"https://github.com/BVLC/caffe/issues/4834#issuecomment-253213069","issue_url":"https://api.github.com/repos/BVLC/caffe/issues/4834","id":253213069,"user":{"login":"mkyaqub","id":2682873,"avatar_url":"https://avatars.githubusercontent.com/u/2682873?v=3","gravatar_id":"","url":"https://api.github.com/users/mkyaqub","html_url":"https://github.com/mkyaqub","followers_url":"https://api.github.com/users/mkyaqub/followers","following_url":"https://api.github.com/users/mkyaqub/following{/other_user}","gists_url":"https://api.github.com/users/mkyaqub/gists{/gist_id}","starred_url":"https://api.github.com/users/mkyaqub/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mkyaqub/subscriptions","organizations_url":"https://api.github.com/users/mkyaqub/orgs","repos_url":"https://api.github.com/users/mkyaqub/repos","events_url":"https://api.github.com/users/mkyaqub/events{/privacy}","received_events_url":"https://api.github.com/users/mkyaqub/received_events","type":"User","site_admin":false},"created_at":"2016-10-12T13:28:22Z","updated_at":"2016-10-12T13:28:22Z","body":"Thanks Willyd,\r\n\r\nCan you please elaborate on how to review  the nvcc compiler flags?\r\n\r\nYes, I managed to compile Caffe on Windows with Cuda 8.0. The steps are:\r\nInstall Cuda 8.0, disable cuDNN in the CommonSettings file (apologies I said I succeeded with cuDNN but I did not. I got confused with the many things I tried). Launch the caffe solution in VS2013 and compile. I tested by training an FCN model on the CPU and it was fine.\r\nHere are the two changes you need to do in the CommonSettings file\r\n<UseCuDNN>false</UseCuDNN>\r\n        <CudaVersion>8.0</CudaVersion>\r\n\r\nBTW, I realized that Titan X Pascal uses compute 6.1 architecture while the older GTX Titan X uses 5.2 architecture so I tried to change cuda architecture tag in the CommonSettings file to 6.1. Caffe compiled fine after a few iterations but I still got the same error.\r\nI changed this line <CudaArchitecture>compute_35,sm_35;compute_52,sm_52</CudaArchitecture> to \r\n<CudaArchitecture>compute_61,sm_61</CudaArchitecture>\r\n\r\n,"}}
{"actor":{"display_login":"mkyaqub"}}