{"action":"created","issue":{"url":"https://api.github.com/repos/deeplearning4j/nd4j/issues/2750","repository_url":"https://api.github.com/repos/deeplearning4j/nd4j","labels_url":"https://api.github.com/repos/deeplearning4j/nd4j/issues/2750/labels{/name}","comments_url":"https://api.github.com/repos/deeplearning4j/nd4j/issues/2750/comments","events_url":"https://api.github.com/repos/deeplearning4j/nd4j/issues/2750/events","html_url":"https://github.com/deeplearning4j/nd4j/issues/2750","id":305864582,"number":2750,"title":"GPU training is slower than CPU","user":{"login":"clavvis","id":31794846,"avatar_url":"https://avatars1.githubusercontent.com/u/31794846?v=4","gravatar_id":"","url":"https://api.github.com/users/clavvis","html_url":"https://github.com/clavvis","followers_url":"https://api.github.com/users/clavvis/followers","following_url":"https://api.github.com/users/clavvis/following{/other_user}","gists_url":"https://api.github.com/users/clavvis/gists{/gist_id}","starred_url":"https://api.github.com/users/clavvis/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/clavvis/subscriptions","organizations_url":"https://api.github.com/users/clavvis/orgs","repos_url":"https://api.github.com/users/clavvis/repos","events_url":"https://api.github.com/users/clavvis/events{/privacy}","received_events_url":"https://api.github.com/users/clavvis/received_events","type":"User","site_admin":false},"labels":[{"id":362152002,"url":"https://api.github.com/repos/deeplearning4j/nd4j/labels/question","name":"question","color":"cc317c","default":true}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":24,"created_at":"2018-03-16T09:55:57Z","updated_at":"2018-03-19T18:49:19Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"I bought new GPU with GTX 1060 6GB. Set Nd4jBeckend as CUDA 8.0. I downloaded NVidia CUDA Toolkit 8.0 and patch 2 and both installed.\r\nI set GPU memory limit 6GB.\r\n\r\nI start training my neural network (I use dl4j 0.91) and I see it is slow. It is slower almost two times than CPU training.\r\nGPU average load is 1-3 %. It is not training - it is only screen showing !!!\r\nCPU load is 50-85%. In CPU training was 97-100%.\r\nGPU memory usage is 2-3 GB.\r\nMy data is not big. I guess tents MB.\r\n\r\nI use those commands:\r\nlogger.info(\"Nd4jBackend.BACKEND_PRIORITY_CPU: {}\", Nd4jBackend.BACKEND_PRIORITY_CPU);\r\nlogger.info(\"Nd4jBackend.BACKEND_PRIORITY_GPU: {}\", Nd4jBackend.BACKEND_PRIORITY_GPU);\r\n//\r\nlogger.info(\"Nd4j.getBackend(): {}\", Nd4j.getBackend().getClass().getSimpleName());\r\nlogger.info(\"getBackend.getPriority(): {}\", Nd4j.getBackend().getPriority());\r\n\t\t\r\nConsole shows:\r\nc.vhr.bac.BAC36 - Nd4jBackend.BACKEND_PRIORITY_CPU: 0\r\nc.vhr.bac.BAC36 - Nd4jBackend.BACKEND_PRIORITY_GPU: 100\r\no.n.l.f.Nd4jBackend - Loaded [JCublasBackend] backend\r\no.r.Reflections - Reflections took 587 ms to scan 388 urls, producing 128519 keys and 140910 values \r\no.n.n.NativeOpsHolder - Number of threads used for NativeOps: 32\r\no.r.Reflections - Reflections took 115 ms to scan 19 urls, producing 31 keys and 227 values \r\no.n.l.a.o.e.DefaultOpExecutioner - Backend used: [CUDA]; OS: [Windows 10]\r\no.n.l.a.o.e.DefaultOpExecutioner - Cores: [8]; Memory: [3,6GB];\r\no.n.l.a.o.e.DefaultOpExecutioner - Blas vendor: [CUBLAS]\r\no.n.l.j.o.e.CudaExecutioner - Device name: [GeForce GTX 1060 6GB]; CC: [6.1]; Total/free memory: [6442450944]\r\nc.vhr.bac.BAC36 - Nd4j.getBackend(): JCublasBackend\r\nc.vhr.bac.BAC36 - getBackend.getPriority(): 100\r\n\r\nI don't see error. Could you help me?\r\n\r\nThank you"},"comment":{"url":"https://api.github.com/repos/deeplearning4j/nd4j/issues/comments/374324243","html_url":"https://github.com/deeplearning4j/nd4j/issues/2750#issuecomment-374324243","issue_url":"https://api.github.com/repos/deeplearning4j/nd4j/issues/2750","id":374324243,"user":{"login":"raver119","id":12250879,"avatar_url":"https://avatars2.githubusercontent.com/u/12250879?v=4","gravatar_id":"","url":"https://api.github.com/users/raver119","html_url":"https://github.com/raver119","followers_url":"https://api.github.com/users/raver119/followers","following_url":"https://api.github.com/users/raver119/following{/other_user}","gists_url":"https://api.github.com/users/raver119/gists{/gist_id}","starred_url":"https://api.github.com/users/raver119/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/raver119/subscriptions","organizations_url":"https://api.github.com/users/raver119/orgs","repos_url":"https://api.github.com/users/raver119/repos","events_url":"https://api.github.com/users/raver119/events{/privacy}","received_events_url":"https://api.github.com/users/raver119/received_events","type":"User","site_admin":false},"created_at":"2018-03-19T18:49:19Z","updated_at":"2018-03-19T18:49:19Z","author_association":"CONTRIBUTOR","body":"Get any java profiler tool (ie JVisualVm or YourKit profiler) and make screenshot of GC tab please."}}
{"actor":{"display_login":"raver119"}}