{"action":"created","issue":{"url":"https://api.github.com/repos/onnx/onnx-tensorrt/issues/35","repository_url":"https://api.github.com/repos/onnx/onnx-tensorrt","labels_url":"https://api.github.com/repos/onnx/onnx-tensorrt/issues/35/labels{/name}","comments_url":"https://api.github.com/repos/onnx/onnx-tensorrt/issues/35/comments","events_url":"https://api.github.com/repos/onnx/onnx-tensorrt/issues/35/events","html_url":"https://github.com/onnx/onnx-tensorrt/issues/35","id":343320593,"node_id":"MDU6SXNzdWUzNDMzMjA1OTM=","number":35,"title":"TensorRT doesn't accelerate","user":{"login":"Faldict","id":15966802,"node_id":"MDQ6VXNlcjE1OTY2ODAy","avatar_url":"https://avatars1.githubusercontent.com/u/15966802?v=4","gravatar_id":"","url":"https://api.github.com/users/Faldict","html_url":"https://github.com/Faldict","followers_url":"https://api.github.com/users/Faldict/followers","following_url":"https://api.github.com/users/Faldict/following{/other_user}","gists_url":"https://api.github.com/users/Faldict/gists{/gist_id}","starred_url":"https://api.github.com/users/Faldict/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Faldict/subscriptions","organizations_url":"https://api.github.com/users/Faldict/orgs","repos_url":"https://api.github.com/users/Faldict/repos","events_url":"https://api.github.com/users/Faldict/events{/privacy}","received_events_url":"https://api.github.com/users/Faldict/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2018-07-21T11:38:53Z","updated_at":"2018-08-08T02:17:33Z","closed_at":null,"author_association":"NONE","body":"Compared with original models, the time cost using tensorrt engine is two times more. So why doesn't it accelerate the running speed? The figure below shows the MXNet model and TensorRT engine's running time per batch.\r\n\r\n![pk](https://user-images.githubusercontent.com/15966802/43067674-956b9e16-8e9a-11e8-91fc-dde142eab319.png)\r\n\r\nSometimes, it occurs such errors:\r\n\r\n```\r\nCuda error in file src/implicit_gemm.cu at line 1214: invalid resource handle\r\n[TensorRT] ERROR: customWinogradConvActLayer.cpp (308) - Cuda Error in execute: 33\r\n[TensorRT] ERROR: customWinogradConvActLayer.cpp (308) - Cuda Error in execute: 33\r\n```\r\nIt's very weird, and I don't know what happened."},"comment":{"url":"https://api.github.com/repos/onnx/onnx-tensorrt/issues/comments/411261518","html_url":"https://github.com/onnx/onnx-tensorrt/issues/35#issuecomment-411261518","issue_url":"https://api.github.com/repos/onnx/onnx-tensorrt/issues/35","id":411261518,"node_id":"MDEyOklzc3VlQ29tbWVudDQxMTI2MTUxOA==","user":{"login":"Faldict","id":15966802,"node_id":"MDQ6VXNlcjE1OTY2ODAy","avatar_url":"https://avatars1.githubusercontent.com/u/15966802?v=4","gravatar_id":"","url":"https://api.github.com/users/Faldict","html_url":"https://github.com/Faldict","followers_url":"https://api.github.com/users/Faldict/followers","following_url":"https://api.github.com/users/Faldict/following{/other_user}","gists_url":"https://api.github.com/users/Faldict/gists{/gist_id}","starred_url":"https://api.github.com/users/Faldict/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Faldict/subscriptions","organizations_url":"https://api.github.com/users/Faldict/orgs","repos_url":"https://api.github.com/users/Faldict/repos","events_url":"https://api.github.com/users/Faldict/events{/privacy}","received_events_url":"https://api.github.com/users/Faldict/received_events","type":"User","site_admin":false},"created_at":"2018-08-08T02:17:33Z","updated_at":"2018-08-08T02:17:33Z","author_association":"NONE","body":"@benbarsdell Thanks for your reply. I tried with `batch_size = max_batch_size = 32`, but it still performed slower than the original MXNet model. So what can I do?"}}
{"actor":{"display_login":"Faldict"}}