Arpan Rajani arpan57
arpan57
/ Metricbeat-kafkaObservability.txt
Last active
April 29, 2021 00:05
Steps to get Kafka metrics to ELK Dashboard
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| For observability of Kafka cluster through Elastic Search and Kibana, install and configure metricbeat. | |
| Following is tested on 3 node Kafka Cluster installed on a single EC2 host, ELK installed on another EC2 host. Did not configure any authentication/authorization for the ease of setup. | |
| Steps for Metricbeat | |
| ========================================== | |
| 1. Referring to the documentation link from references download the tarball or RPM | |
| 2. Extract/install the RPM on the Kafka host | |
| 3. Post installation, update the metricbeat.yml (usually /etc/metricbeat/metricbeat.yml) | |
| update the host entry under setup.kibana to point to Kibana endpoint | |
| setup.kibana: |