<p>I deploying a python + tensorflow + flask application using a fully managed Google Cloud Run Service (1 vCPUs and 4 GB Ram).</p>
<p>System works fine but it is really slow, so I am evaluating ways of making it fast (it needs to run 20-30 times faster than what is doing now)</p>
<p>What would be the best approach?</p>
<ul>
<li>To use a Kubernetes Cluster with one or two powerful machines</li>
<li>To use a Kubernetes Cluster with 3-5 weaker machines</li>
<li>To forget about Kubernets/Docker and run everything on single powerfull VM</li>
<li>Something else maybe?</li>
</ul>
<p>For now I don't expect to have more than 10 users at a time but I want to be able to scale it up eventually.</p>

John Moody
<p>You might want to evaluate according to your use case</p>
<p><a href="https://cloud.google.com/blog/products/containers-kubernetes/when-to-use-google-kubernetes-engine-vs-cloud-run-for-containers" rel="nofollow noreferrer">Per this article,</a> Fully managed Cloud Run is an ideal serverless platform for stateless containerized microservices that don’t require Kubernetes features like namespaces, co-location of containers in pods (sidecars) or node allocation and management.</p>
<p>GKE is a great choice if you are looking for a container orchestration platform that offers advanced scalability and configuration flexibility.</p>
<p>You mentioned you are looking the cheaper/easier method to develop, but this will probably not be as scalable, efficient or manageable, you might want to take a closer look at all <a href="https://cloud.google.com/hosting-options" rel="nofollow noreferrer">cloud compute options</a> in GCP to see what could benefit your use case the most.</p>
<p>You mentioned your use case is CPU intensive, so you might want to leverage the <a href="https://cloud.google.com/compute/docs/machine-types#highcpu" rel="nofollow noreferrer">high CPU machine types</a>, these might be used directly by creating a VM, creating an <a href="https://cloud.google.com/compute/docs/instance-groups" rel="nofollow noreferrer">instance group</a> or using them in other services like <a href="https://cloud.google.com/kubernetes-engine/docs/concepts/cluster-architecture#memory_cpu" rel="nofollow noreferrer">GKE</a> or <a href="https://cloud.google.com/appengine/docs/standard#instance_classes" rel="nofollow noreferrer">App Engine</a></p>
