<p>I have installed minikube cluster and kfserving on a linux desktop.
Then I have followed two tutorials <br>
<a href="https://github.com/kubeflow/kfserving/tree/master/docs/samples/v1beta1/custom/torchserve" rel="nofollow noreferrer">https://github.com/kubeflow/kfserving/tree/master/docs/samples/v1beta1/custom/torchserve</a> <br>
<a href="https://github.com/kubeflow/kfserving/tree/master/docs/samples/v1alpha2/custom/kfserving-custom-model" rel="nofollow noreferrer">https://github.com/kubeflow/kfserving/tree/master/docs/samples/v1alpha2/custom/kfserving-custom-model</a> <br></p>
<p>In the second tutorial I have needed to move &quot;name: custom&quot; from &quot;custom:&quot; section to &quot;container:&quot; section in the yaml file. <br>
I expected that serving service was working and responding to serving requests and pods of the service where in kubernetes.  <br>
I use the newest stable versions from May 2021.<br></p>
<p>But I have same bug in both tutorials. Bellow commands are from the first tutorial. When I prepare docker images with models and run</p>
<pre><code>$ kubectl apply -f torchserve-custom.yaml
</code></pre>
<p>command.  <br>
I see output like</p>
<pre><code>inferenceservice.serving.kubeflow.org/torchserve-custom created
</code></pre>
<p>But I can not run a prediction, because service I get 404 not found. <br>
When I run</p>
<pre><code>$ kubectl get pods --all-namespaces
</code></pre>
<p>I do not see any new pods. <br>
But I can deleted service with</p>
<pre><code> $ kubectl delete -f torchserve-custom
</code></pre>
<p>When I have followed other tutorials like: <a href="https://github.com/kubeflow/kfserving/tree/master/docs/samples/v1beta1/torchserve" rel="nofollow noreferrer">https://github.com/kubeflow/kfserving/tree/master/docs/samples/v1beta1/torchserve</a> everything worked fine and I could run predictions.</p>
<p>Why can`t I run a prediction?</p>
<p>Why any new pods are created?</p>
<p>How to setup serving in kfserving using docker image, if the above tutorials did not worked?</p>

jabone
<p>It turned out that my local docker registry wasn't visible from kubernetes. <code>kubectl get events</code> shows InternalError &quot;Unable to fetch image ... &quot;</p>
