<p>TensorRT 3.0 supports import/conversion of TensorFlow graphs via it's UFF (universal framework format). Some layer implementations are missing and will require custom implementations via IPlugin interface.</p>

<p>Previous versions didn't support native import of TensorFlow models/checkpoints.</p>

<p>What you can also do is export the layers/network description into your own intermediate format (such as text file) and then use TensorRT C++ API to construct the graph for inference. You'd have to export the convolution weights/biases separately. Make sure to pay attention to weight format - TensorFlow uses NHWC while TensorRT uses NCHW. And for the weights, TF uses RSCK ([filter_height, filter_width, input_depth, output_depth]) and TensorRT uses KCRS.</p>

<p>See this paper for an extended discussion of tensor formats:
<a href="https://arxiv.org/abs/1410.0759" rel="noreferrer">https://arxiv.org/abs/1410.0759</a></p>

<p>Also this link has useful relevant info:
<a href="https://www.tensorflow.org/versions/master/extend/tool_developers/" rel="noreferrer">https://www.tensorflow.org/versions/master/extend/tool_developers/</a></p>
Run Tensorflow with NVIDIA TensorRT Inference Engine
<p>I would like to use NVIDIA TensorRT to run my Tensorflow models. Currenly, TensorRT supports Caffe prototxt network descriptor files.</p>

<p>I was not able to find source code to convert Tensorflow models to Caffe models. Are there any workarounds?</p>