{"action":"created","issue":{"url":"https://api.github.com/repos/torch/cutorch/issues/654","repository_url":"https://api.github.com/repos/torch/cutorch","labels_url":"https://api.github.com/repos/torch/cutorch/issues/654/labels{/name}","comments_url":"https://api.github.com/repos/torch/cutorch/issues/654/comments","events_url":"https://api.github.com/repos/torch/cutorch/issues/654/events","html_url":"https://github.com/torch/cutorch/issues/654","id":197889984,"number":654,"title":"Error when trying to use CudaHalfTensor for training","user":{"login":"marcel1991","id":16177860,"avatar_url":"https://avatars.githubusercontent.com/u/16177860?v=3","gravatar_id":"","url":"https://api.github.com/users/marcel1991","html_url":"https://github.com/marcel1991","followers_url":"https://api.github.com/users/marcel1991/followers","following_url":"https://api.github.com/users/marcel1991/following{/other_user}","gists_url":"https://api.github.com/users/marcel1991/gists{/gist_id}","starred_url":"https://api.github.com/users/marcel1991/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/marcel1991/subscriptions","organizations_url":"https://api.github.com/users/marcel1991/orgs","repos_url":"https://api.github.com/users/marcel1991/repos","events_url":"https://api.github.com/users/marcel1991/events{/privacy}","received_events_url":"https://api.github.com/users/marcel1991/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-12-28T17:40:31Z","updated_at":"2016-12-28T18:53:20Z","closed_at":null,"body":"I want to train my model using fp16 precision on my gpu. My gpu has the Pascal architecture and the cutorch.hasHalf flag indicates true. I am using cuDNN 5.1 and CUDA Toolkit 8.0.\r\n\r\nAs far as I understand it right I only have to change the Tensors that are allocated on my gpu from CudaTensor to CudaHalfTensor and the calculations should be in fp16 precision. However, when I do that I get an error on using the optim.sgd() function that says: \"No algorithms found that would fit in free GPU memory\".\r\n\r\nAm I doing something wrong? Or is fp16 actually supported for a VGG16 model using sgd?\r\n\r\nThe detailed error message is:\r\n```\r\nIn 1 module of nn.Sequential:\r\n/home/.../torch/install/share/lua/5.1/cudnn/find.lua:469: No algorithms found that would fit in free GPU memory\r\nstack traceback:\r\n\t[C]: in function 'error'\r\n\t/home/.../torch/install/share/lua/5.1/cudnn/find.lua:469: in function 'forwardAlgorithm'\r\n\t...torch/install/share/lua/5.1/cudnn/SpatialConvolution.lua:189: in function <...torch/install/share/lua/5.1/cudnn/SpatialConvolution.lua:185>\r\n\t[C]: in function 'xpcall'\r\n\t/home/.../torch/install/share/lua/5.1/nn/Container.lua:63: in function 'rethrowErrors'\r\n\t/home/.../torch/install/share/lua/5.1/nn/Sequential.lua:44: in function 'forward'\r\n\t./trainManager.lua:103: in function 'opfunc'\r\n\t/home/.../torch/install/share/lua/5.1/optim/sgd.lua:44: in function 'sgd'\r\n\r\n```"},"comment":{"url":"https://api.github.com/repos/torch/cutorch/issues/comments/269522327","html_url":"https://github.com/torch/cutorch/issues/654#issuecomment-269522327","issue_url":"https://api.github.com/repos/torch/cutorch/issues/654","id":269522327,"user":{"login":"marcel1991","id":16177860,"avatar_url":"https://avatars.githubusercontent.com/u/16177860?v=3","gravatar_id":"","url":"https://api.github.com/users/marcel1991","html_url":"https://github.com/marcel1991","followers_url":"https://api.github.com/users/marcel1991/followers","following_url":"https://api.github.com/users/marcel1991/following{/other_user}","gists_url":"https://api.github.com/users/marcel1991/gists{/gist_id}","starred_url":"https://api.github.com/users/marcel1991/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/marcel1991/subscriptions","organizations_url":"https://api.github.com/users/marcel1991/orgs","repos_url":"https://api.github.com/users/marcel1991/repos","events_url":"https://api.github.com/users/marcel1991/events{/privacy}","received_events_url":"https://api.github.com/users/marcel1991/received_events","type":"User","site_admin":false},"created_at":"2016-12-28T18:53:20Z","updated_at":"2016-12-28T18:53:20Z","body":"No unfortunately that didn't solve the error. I tried it with various sizes smaller than 8.\r\n\r\nI'm new to torch and installed it one month ago so I guess I have the newest cudnn.torch version."}}
{"actor":{"display_login":"marcel1991"}}