{"action":"created","issue":{"url":"https://api.github.com/repos/Microsoft/CNTK/issues/1174","repository_url":"https://api.github.com/repos/Microsoft/CNTK","labels_url":"https://api.github.com/repos/Microsoft/CNTK/issues/1174/labels{/name}","comments_url":"https://api.github.com/repos/Microsoft/CNTK/issues/1174/comments","events_url":"https://api.github.com/repos/Microsoft/CNTK/issues/1174/events","html_url":"https://github.com/Microsoft/CNTK/issues/1174","id":195677071,"number":1174,"title":"Training vgg9  /w grayscale generates cuDNN failure 8: CUDNN_STATUS_EXECUTION_FAILED","user":{"login":"wwindels","id":24577129,"avatar_url":"https://avatars.githubusercontent.com/u/24577129?v=3","gravatar_id":"","url":"https://api.github.com/users/wwindels","html_url":"https://github.com/wwindels","followers_url":"https://api.github.com/users/wwindels/followers","following_url":"https://api.github.com/users/wwindels/following{/other_user}","gists_url":"https://api.github.com/users/wwindels/gists{/gist_id}","starred_url":"https://api.github.com/users/wwindels/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wwindels/subscriptions","organizations_url":"https://api.github.com/users/wwindels/orgs","repos_url":"https://api.github.com/users/wwindels/repos","events_url":"https://api.github.com/users/wwindels/events{/privacy}","received_events_url":"https://api.github.com/users/wwindels/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-12-14T23:38:21Z","updated_at":"2016-12-15T00:53:13Z","closed_at":null,"body":"CNTK install: **CNTK-2-0-beta5-0-Windows-64bit-GPU**\r\nUsing the CNTK tutorial 201B I got 5 models working with the CIFAR-10 data.  I've since converted to use my .png data  which differs in size and color depth.  ie. (1, 128, 128) grayscale. All tutorial models work fine with my grayscale .png files **except vgg9**.\r\nI get the following error:\r\ncuDNN failure 8: CUDNN_STATUS_EXECUTION_FAILED ; GPU=0 ; hostname=???????? ; expr=cudnnConvolutionBackwardFilter(*m_cudnn, &C::One, m_inT, ptr(in), m_outT, ptr(srcGrad), *m_conv, m_backFiltAlgo.Algo.algo, ptr(workspace), m_backFiltAlgo.Algo.memory, &C::One, *m_kernelT, ptr(kernelGrad))\r\nTraceback (most recent call last):\r\n  File \"PureTrainCNN.py\", line 374, in <module>\r\n    pred_vgg = train_and_evaluate(reader_train, reader_test, max_epochs=EPOCHS, model_func=create_vgg9_model)\r\n  File \"PureTrainCNN.py\", line 249, in train_and_evaluate\r\n    trainer.train_minibatch(data)  # update model with it\r\n  File \"C:\\local\\Anaconda3-4.1.1-Windows-x86_64\\envs\\cntk-py34\\lib\\site-packages\\cntk\\trainer.py\", line 92, in train_minibatch\r\n    updated = super(Trainer, self).train_minibatch(arguments, device)\r\n  File \"C:\\local\\Anaconda3-4.1.1-Windows-x86_64\\envs\\cntk-py34\\lib\\site-packages\\cntk\\cntk_py.py\", line 1644, in train_minibatch\r\n    return _cntk_py.Trainer_train_minibatch(self, *args)\r\nRuntimeError: cuDNN failure 8: CUDNN_STATUS_EXECUTION_FAILED ; GPU=0 ; hostname=???????? ; expr=cudnnConvolutionBackwardFilter(*m_cudnn, &C::One, m_inT, ptr(in), m_outT, ptr(srcGrad), *m_conv, m_backFiltAlgo.Algo.algo, ptr(workspace), m_backFiltAlgo.Algo.memory, &C::One, *m_kernelT, ptr(kernelGrad))\r\n"},"comment":{"url":"https://api.github.com/repos/Microsoft/CNTK/issues/comments/267204106","html_url":"https://github.com/Microsoft/CNTK/issues/1174#issuecomment-267204106","issue_url":"https://api.github.com/repos/Microsoft/CNTK/issues/1174","id":267204106,"user":{"login":"wwindels","id":24577129,"avatar_url":"https://avatars.githubusercontent.com/u/24577129?v=3","gravatar_id":"","url":"https://api.github.com/users/wwindels","html_url":"https://github.com/wwindels","followers_url":"https://api.github.com/users/wwindels/followers","following_url":"https://api.github.com/users/wwindels/following{/other_user}","gists_url":"https://api.github.com/users/wwindels/gists{/gist_id}","starred_url":"https://api.github.com/users/wwindels/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wwindels/subscriptions","organizations_url":"https://api.github.com/users/wwindels/orgs","repos_url":"https://api.github.com/users/wwindels/repos","events_url":"https://api.github.com/users/wwindels/events{/privacy}","received_events_url":"https://api.github.com/users/wwindels/received_events","type":"User","site_admin":false},"created_at":"2016-12-15T00:53:13Z","updated_at":"2016-12-15T00:53:13Z","body":"I'm using the create_reader / ImageDesealizer etc from CNTK tutorial 201B.  I don't suspect the reader since I can successfully train the other 4 models in that tutorial with my same grayscale images.  It appears specific to the vgg9 model.\r\n"}}
{"actor":{"display_login":"wwindels"}}