<p>Our application is built on top of K8S Cluster, that is to manage large amount of devices. One of the feature is, if any device becomes offline, a notification would be triggered and an email would be sent out to the user.</p>
<p>But, since 2 weeks ago, such feature no longer works, and emails are not sent.</p>
<p>And since the guy used to work on the kafka part has left the company, I need to figure out if kafka service is still working health myself.</p>
<p>I am quite new to kafka, when I login the master node on k8s, I have see such pods that kafka related.</p>
<pre><code>k8s -n kafka get pods
NAME                              READY   STATUS    RESTARTS   AGE
kafka-0                           1/1     Running   779        466d
kafka-1                           1/1     Running   848        2y266d
kafka-2                           1/1     Running   797        466d
kafka-exporter-58c76747c6-j2cv2   1/1     Running   306        292d
kafka-manager-844657d4bf-q2j7n    1/1     Running   1647       2y215d
kafka-zookeeper-0                 1/1     Running   574        466d
kafka-zookeeper-1                 1/1     Running   573        2y266d
kafka-zookeeper-2                 1/1     Running   569        466d
</code></pre>
<p>Where should I start any type of sanity checking on Kafka service</p>

user3595231
<p>You have both <code>kafka-exporter</code> and <code>kafka-manager</code> services.</p>
<p>Both of these have their own ability to check the health of Kafka via HTTP requests, either to the exporter's metrics endpoint (or Prometheus / Grafana, if these also exist in your cluster), or to the kafka-manager UI, rather than Kafka itself, and are not specific to kubectl commands.</p>
<p>More information</p>
<ul>
<li><a href="https://github.com/danielqsj/kafka_exporter" rel="nofollow noreferrer">https://github.com/danielqsj/kafka_exporter</a></li>
<li><a href="https://github.com/yahoo/CMAK" rel="nofollow noreferrer">https://github.com/yahoo/CMAK</a> (previously known as kafka-manager)</li>
</ul>
<p>Alternatively, you could migrate to an installation of <a href="https://strimzi.io" rel="nofollow noreferrer">https://strimzi.io</a> , which comes with its own monitoring stack based on Prometheus.</p>
