title: Smooth load rebalancing for Kubernetes HPA
body: <p>I have configured my ingress controller with nginx-ingress <a href="https://kubernetes.github.io/ingress-nginx/user-guide/nginx-configuration/annotations/#custom-nginx-upstream-hashing" rel="nofollow noreferrer">hashing</a> and I define HPA for my deployments. When we do load testing we hit a problem on the newly created pods that aren't warmed up enough and while the load balancing shifts immediately target portion of the traffic the latency spikes and service is choking. Is there a way to define some smooth load rebalancing that would rather move the traffic gradually and thus warm up the service in more natural way ?</p>
  
  <p>Here is an example effect we see now:
  <a href="https://i.stack.imgur.com/5MVT6.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/5MVT6.png" alt="enter image description here"></a></p>