<p>We have a Flask server, which makes gRPC calls to a Tensorflow Serving POD(which uses Official tf-serving docker image) that serves around 20 tensorflow models. Both Flask microservice and Tf-Serving microservice are deployed on Kubernetes.
For 0.5-1% of the requests made from Flask to Tf-Serving, Flask server is throwing an RpcError - <strong>StatusCode.DEADLINE_EXCEEDED</strong></p>

<p>There is a similar issue on github: <a href="https://github.com/tensorflow/serving/issues/1265" rel="nofollow noreferrer">https://github.com/tensorflow/serving/issues/1265</a> .Please help me to resolve this issue.  </p>

<p>This issue is due to proxy issue. To get rid of Deadline Exceed issue, try:</p>
<pre><code>import os
if os.environ.get(&quot;http_proxy&quot;):
    del os.environ[&quot;http_proxy&quot;]
if os.environ.get(&quot;https_proxy&quot;):
    del os.environ[&quot;https_proxy&quot;]
</code></pre>
