{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/serving/issues/864","repository_url":"https://api.github.com/repos/tensorflow/serving","labels_url":"https://api.github.com/repos/tensorflow/serving/issues/864/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/serving/issues/864/comments","events_url":"https://api.github.com/repos/tensorflow/serving/issues/864/events","html_url":"https://github.com/tensorflow/serving/issues/864","id":318293702,"node_id":"MDU6SXNzdWUzMTgyOTM3MDI=","number":864,"title":" Build serving with TensorRT?","user":{"login":"kitterive","id":16040174,"node_id":"MDQ6VXNlcjE2MDQwMTc0","avatar_url":"https://avatars0.githubusercontent.com/u/16040174?v=4","gravatar_id":"","url":"https://api.github.com/users/kitterive","html_url":"https://github.com/kitterive","followers_url":"https://api.github.com/users/kitterive/followers","following_url":"https://api.github.com/users/kitterive/following{/other_user}","gists_url":"https://api.github.com/users/kitterive/gists{/gist_id}","starred_url":"https://api.github.com/users/kitterive/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kitterive/subscriptions","organizations_url":"https://api.github.com/users/kitterive/orgs","repos_url":"https://api.github.com/users/kitterive/repos","events_url":"https://api.github.com/users/kitterive/events{/privacy}","received_events_url":"https://api.github.com/users/kitterive/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2018-04-27T06:36:32Z","updated_at":"2018-07-07T11:09:33Z","closed_at":null,"author_association":"NONE","body":"I understand that Tensorrt can speed up forward inference , can I build serving with tensorrt?  so that TensorRT can optimize saved model sub graph, and use it for inference? "},"comment":{"url":"https://api.github.com/repos/tensorflow/serving/issues/comments/403207951","html_url":"https://github.com/tensorflow/serving/issues/864#issuecomment-403207951","issue_url":"https://api.github.com/repos/tensorflow/serving/issues/864","id":403207951,"node_id":"MDEyOklzc3VlQ29tbWVudDQwMzIwNzk1MQ==","user":{"login":"bhack","id":1710528,"node_id":"MDQ6VXNlcjE3MTA1Mjg=","avatar_url":"https://avatars0.githubusercontent.com/u/1710528?v=4","gravatar_id":"","url":"https://api.github.com/users/bhack","html_url":"https://github.com/bhack","followers_url":"https://api.github.com/users/bhack/followers","following_url":"https://api.github.com/users/bhack/following{/other_user}","gists_url":"https://api.github.com/users/bhack/gists{/gist_id}","starred_url":"https://api.github.com/users/bhack/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bhack/subscriptions","organizations_url":"https://api.github.com/users/bhack/orgs","repos_url":"https://api.github.com/users/bhack/repos","events_url":"https://api.github.com/users/bhack/events{/privacy}","received_events_url":"https://api.github.com/users/bhack/received_events","type":"User","site_admin":false},"created_at":"2018-07-07T11:09:33Z","updated_at":"2018-07-07T11:09:33Z","author_association":"NONE","body":"In the meanwhile you can use Nvidia [TensorRT inference server](https://docs.nvidia.com/deeplearning/sdk/inference-user-guide/index.html)"}}
{"actor":{"display_login":"bhack"}}