<p>We are target using Prometheus, alertmanager and Grafana for monitoring AKS but it has been found that cannot obtain the kubelet metrics, I don't know whether it is blackbox/hidden by Azure or not. In addition, container CPU usage i.e. container_cpu_usage_seconds_total cannot obtain in Prometheus. Is anyone have experience on using Prometheus to monitor AKS ? </p>

<p>Remark: I using this <a href="https://github.com/camilb/prometheus-kubernetes" rel="nofollow noreferrer">https://github.com/camilb/prometheus-kubernetes</a> to install Prometheus on AKS</p>

<p>I assume kubelet is not being detected target to scrape metrics from.
it has to do with your AKS version,
in prior 1.15 versions the metrics-server was started as follow:</p>
<ul>
<li>command:
<ul>
<li>/metrics-server</li>
<li>--kubelet-port=10255</li>
<li>--deprecated-kubelet-completely-insecure=true</li>
<li>--kubelet-preferred-address-types=InternalIP,Hostname,InternalDNS,ExternalDNS,ExternalIP</li>
</ul>
</li>
</ul>
<p>while in recent versions of aks:</p>
<ul>
<li>command:
<ul>
<li>/metrics-server</li>
<li>--kubelet-insecure-tls</li>
<li>--kubelet-preferred-address-types=InternalIP</li>
</ul>
</li>
</ul>
