{"action":"created","issue":{"url":"https://api.github.com/repos/deeplearning4j/nd4j/issues/884","repository_url":"https://api.github.com/repos/deeplearning4j/nd4j","labels_url":"https://api.github.com/repos/deeplearning4j/nd4j/issues/884/labels{/name}","comments_url":"https://api.github.com/repos/deeplearning4j/nd4j/issues/884/comments","events_url":"https://api.github.com/repos/deeplearning4j/nd4j/issues/884/events","html_url":"https://github.com/deeplearning4j/nd4j/issues/884","id":152742172,"number":884,"title":"CUDA state","user":{"login":"raver119","id":12250879,"avatar_url":"https://avatars.githubusercontent.com/u/12250879?v=3","gravatar_id":"","url":"https://api.github.com/users/raver119","html_url":"https://github.com/raver119","followers_url":"https://api.github.com/users/raver119/followers","following_url":"https://api.github.com/users/raver119/following{/other_user}","gists_url":"https://api.github.com/users/raver119/gists{/gist_id}","starred_url":"https://api.github.com/users/raver119/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/raver119/subscriptions","organizations_url":"https://api.github.com/users/raver119/orgs","repos_url":"https://api.github.com/users/raver119/repos","events_url":"https://api.github.com/users/raver119/events{/privacy}","received_events_url":"https://api.github.com/users/raver119/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/deeplearning4j/nd4j/labels/0.4r3.9","name":"0.4r3.9","color":"fef2c0"},{"url":"https://api.github.com/repos/deeplearning4j/nd4j/labels/enhancement","name":"enhancement","color":"000080"}],"state":"open","locked":false,"assignee":{"login":"raver119","id":12250879,"avatar_url":"https://avatars.githubusercontent.com/u/12250879?v=3","gravatar_id":"","url":"https://api.github.com/users/raver119","html_url":"https://github.com/raver119","followers_url":"https://api.github.com/users/raver119/followers","following_url":"https://api.github.com/users/raver119/following{/other_user}","gists_url":"https://api.github.com/users/raver119/gists{/gist_id}","starred_url":"https://api.github.com/users/raver119/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/raver119/subscriptions","organizations_url":"https://api.github.com/users/raver119/orgs","repos_url":"https://api.github.com/users/raver119/repos","events_url":"https://api.github.com/users/raver119/events{/privacy}","received_events_url":"https://api.github.com/users/raver119/received_events","type":"User","site_admin":false},"milestone":null,"comments":12,"created_at":"2016-05-03T10:22:23Z","updated_at":"2016-05-08T22:44:54Z","closed_at":null,"body":"During the past week many perf issues ( https://github.com/deeplearning4j/nd4j/issues/848 ) were solved/teaked/etc, so for syntheticRNN test time went down from 2m per 5 iterations to 31-33 seconds.\r\n\r\nSo, we have new set of bottleneck, invisible before:\r\n- We're going to greatly reduce number of shapeInfoBuffers creations. We'll cache & reuse ready buffers, instead of memory for them. That will work, since every other major thing in DL4j involves cycled approach, so data dimensions do widely match.\r\n- We're going to avoid TAD computations, and cache them. The reason behind this idea is equal to noted above.\r\n- We're going to lift off host-only restriction for shapeInfoBuffers. Combined with notes above that'll give slightly better performance."},"comment":{"url":"https://api.github.com/repos/deeplearning4j/nd4j/issues/comments/217750763","html_url":"https://github.com/deeplearning4j/nd4j/issues/884#issuecomment-217750763","issue_url":"https://api.github.com/repos/deeplearning4j/nd4j/issues/884","id":217750763,"user":{"login":"raver119","id":12250879,"avatar_url":"https://avatars.githubusercontent.com/u/12250879?v=3","gravatar_id":"","url":"https://api.github.com/users/raver119","html_url":"https://github.com/raver119","followers_url":"https://api.github.com/users/raver119/followers","following_url":"https://api.github.com/users/raver119/following{/other_user}","gists_url":"https://api.github.com/users/raver119/gists{/gist_id}","starred_url":"https://api.github.com/users/raver119/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/raver119/subscriptions","organizations_url":"https://api.github.com/users/raver119/orgs","repos_url":"https://api.github.com/users/raver119/repos","events_url":"https://api.github.com/users/raver119/events{/privacy}","received_events_url":"https://api.github.com/users/raver119/received_events","type":"User","site_admin":false},"created_at":"2016-05-08T22:44:54Z","updated_at":"2016-05-08T22:44:54Z","body":"So, with latest changes the same iteration on gpu is 2.2s per iteration. For cpu with mkl + 8 cores it's 1.6s.\r\n\r\nCloser nor."}}