Skip to content

Instantly share code, notes, and snippets.

@jigar1101
Last active February 21, 2024 03:36
Show Gist options
  • Save jigar1101/ba02fef8c8a8ccb7550b75e95db2abcd to your computer and use it in GitHub Desktop.
Save jigar1101/ba02fef8c8a8ccb7550b75e95db2abcd to your computer and use it in GitHub Desktop.
Kafka Connect JMX Metrics
jmx_config_reload_failure_total
kafka_consumer_consumer_node_metrics_outgoing_byte_rate
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_23_records_lag_max
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblevent_regionlist_0_records_lag
kafka_connect_connect_metrics_failed_authentication_rate
kafka_producer_producer_metrics_request_rate
kafka_producer_producer_metrics_requests_in_flight
kafka_consumer_consumer_coordinator_metrics_commit_latency_max
kafka_connect_sink_task_metrics_put_batch_max_time_ms
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_20_records_lag_max
kafka_producer_producer_metrics_outgoing_byte_total
java_lang_memory_objectpendingfinalizationcount
kafka_connect_connect_metrics_request_rate
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_status_4_records_lag_avg
kafka_connect_connect_coordinator_metrics_assigned_connectors
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_19_records_lag_avg
java_lang_garbagecollector_lastgcinfo_gcthreadcount
kafka_connect_connect_metrics_outgoing_byte_rate
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_16_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_status_1_records_lag_avg
java_lang_operatingsystem_availableprocessors
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_13_records_lag_avg
kafka_consumer_consumer_node_metrics_outgoing_byte_total
java_lang_memorypool_valid
kafka_producer_producer_metrics_connection_creation_total
kafka_producer_producer_metrics_bufferpool_wait_time_total
java_lang_memorypool_usage_committed
kafka_producer_producer_topic_metrics_record_error_rate
java_lang_threading_daemonthreadcount
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_22_records_lag_avg
java_lang_threading_currentthreadusertime
java_lang_garbagecollector_lastgcinfo_memoryusageaftergc_used
kafka_producer_producer_node_metrics_incoming_byte_rate
kafka_connect_connect_worker_metrics_task_startup_success_percentage
java_lang_garbagecollector_valid
kafka_consumer_consumer_metrics_io_time_ns_avg
java_lang_threading_synchronizerusagesupported
kafka_producer_producer_node_metrics_response_rate
kafka_connect_sink_task_metrics_offset_commit_completion_rate
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblprevdaysales_0_records_lag_avg
java_lang_garbagecollector_lastgcinfo_memoryusagebeforegc_committed
kafka_connect_connect_metrics_select_rate
kafka_connect_connect_worker_rebalance_metrics_rebalancing
java_lang_memorypool_usagethresholdexceeded
kafka_consumer_consumer_node_metrics_incoming_byte_rate
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_14_records_lag_max
kafka_connect_connect_metrics_connection_creation_rate
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_status_2_records_lag_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_11_records_lag_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_17_records_lag_max
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblproducer_0_records_lag
kafka_connect_connect_metrics_network_io_rate
java_lang_classloading_loadedclasscount
kafka_producer_producer_metrics_network_io_rate
kafka_connect_kafka_metrics_count_count
kafka_consumer_consumer_metrics_connection_close_total
kafka_connect_connect_coordinator_metrics_last_heartbeat_seconds_ago
kafka_connect_sink_task_metrics_offset_commit_completion_total
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblsubregion_0_records_lag_max
java_lang_runtime_uptime
java_lang_garbagecollector_lastgcinfo_memoryusagebeforegc_used
kafka_connect_connect_worker_metrics_connector_count
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_6_records_lag
kafka_connect_connect_node_metrics_request_rate
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_8_records_lag
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_0_records_lag
kafka_producer_producer_metrics_io_wait_time_ns_avg
java_lang_threading_objectmonitorusagesupported
java_lang_garbagecollector_lastgcinfo_duration
java_nio_bufferpool_memoryused
kafka_consumer_consumer_fetch_manager_metrics_records_lag_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_2_records_lag
kafka_connect_connect_metrics_network_io_total
kafka_producer_producer_metrics_records_per_request_avg
kafka_connect_connect_coordinator_metrics_sync_total
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_4_records_lag
kafka_consumer_consumer_coordinator_metrics_join_total
kafka_consumer_consumer_node_metrics_request_latency_max
kafka_consumer_consumer_fetch_manager_metrics_fetch_size_max
java_lang_operatingsystem_processcpuload
kafka_producer_producer_node_metrics_outgoing_byte_rate
kafka_producer_producer_topic_metrics_byte_rate
kafka_connect_connect_metrics_io_waittime_total
kafka_connect_connect_worker_metrics_connector_startup_success_total
java_lang_garbagecollector_collectioncount
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblsubregion_0_records_lag
kafka_connect_connect_coordinator_metrics_heartbeat_total
kafka_producer_producer_metrics_connection_creation_rate
java_lang_garbagecollector_lastgcinfo_memoryusageaftergc_committed
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblcollections_0_records_lag
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblproducer_0_records_lag_avg
kafka_consumer_consumer_metrics_failed_authentication_rate
kafka_connect_sink_task_metrics_offset_commit_skip_rate
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_4_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_fetch_rate
kafka_connect_connect_node_metrics_request_latency_avg
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblcollections_0_records_lag_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_1_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblprevdaysales_0_records_lag
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_7_records_lag_avg
kafka_consumer_consumer_metrics_select_rate
java_lang_memory_verbose
kafka_producer_producer_metrics_request_size_max
java_lang_threading_threadallocatedmemoryenabled
kafka_connect_connect_metrics_incoming_byte_rate
kafka_consumer_consumer_metrics_connection_creation_total
kafka_connect_connect_node_metrics_request_size_avg
kafka_producer_producer_metrics_record_queue_time_max
kafka_producer_producer_node_metrics_request_size_avg
kafka_connect_sink_task_metrics_sink_record_send_rate
kafka_connect_connect_worker_rebalance_metrics_completed_rebalances_total
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_10_records_lag_avg
kafka_producer_producer_node_metrics_request_latency_max
kafka_producer_producer_metrics_record_send_rate
kafka_producer_producer_metrics_incoming_byte_rate
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblatm_master_0_records_lag
kafka_producer_producer_metrics_batch_size_max
java_lang_operatingsystem_freeswapspacesize
kafka_consumer_consumer_metrics_connection_count
kafka_connect_connector_task_metrics_offset_commit_failure_percentage
java_lang_operatingsystem_committedvirtualmemorysize
kafka_connect_connect_worker_metrics_task_startup_attempts_total
kafka_consumer_consumer_metrics_select_total
kafka_consumer_consumer_fetch_manager_metrics_records_per_request_avg
kafka_connect_connect_metrics_connection_creation_total
kafka_producer_producer_metrics_record_send_total
kafka_consumer_consumer_fetch_manager_metrics_records_lag_avg
java_lang_garbagecollector_lastgcinfo_memoryusagebeforegc_init
java_lang_operatingsystem_totalphysicalmemorysize
kafka_producer_producer_metrics_record_retry_total
kafka_consumer_consumer_coordinator_metrics_heartbeat_total
kafka_consumer_consumer_fetch_manager_metrics_bytes_consumed_total
kafka_producer_producer_topic_metrics_record_retry_rate
kafka_producer_producer_metrics_connection_count
kafka_connect_connector_task_metrics_pause_ratio
kafka_connect_sink_task_metrics_offset_commit_skip_total
kafka_producer_producer_metrics_batch_size_avg
java_lang_compilation_totalcompilationtime
kafka_connect_connect_metrics_request_size_max
java_lang_threading_threadallocatedmemorysupported
kafka_connect_connector_task_metrics_offset_commit_max_time_ms
kafka_producer_producer_topic_metrics_compression_rate
java_lang_classloading_unloadedclasscount
kafka_consumer_consumer_coordinator_metrics_sync_rate
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblevent_regionlist_0_records_lag_max
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblproducer_0_records_lag_max
kafka_consumer_consumer_coordinator_metrics_heartbeat_rate
kafka_consumer_consumer_metrics_io_wait_time_ns_avg
kafka_consumer_consumer_metrics_iotime_total
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblatm_master_0_records_lag_avg
java_lang_operatingsystem_maxfiledescriptorcount
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_23_records_lag
java_lang_threading_peakthreadcount
kafka_producer_producer_metrics_io_ratio
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_22_records_lag
kafka_connect_connect_worker_metrics_task_startup_failure_percentage
kafka_consumer_consumer_metrics_outgoing_byte_rate
java_lang_memorypool_collectionusage_used
java_lang_memorypool_usage_used
kafka_consumer_consumer_node_metrics_request_rate
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblitemgroup_0_records_lag_max
kafka_connect_connect_worker_metrics_connector_startup_success_percentage
kafka_producer_producer_metrics_request_latency_max
kafka_connect_connect_node_metrics_response_total
kafka_connect_connector_task_metrics_batch_size_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_19_records_lag_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_9_records_lag
java_lang_memory_nonheapmemoryusage_init
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_16_records_lag_max
kafka_producer_kafka_metrics_count_count
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_23_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_1_records_lag
kafka_consumer_consumer_coordinator_metrics_commit_latency_avg
kafka_consumer_consumer_metrics_request_size_max
java_lang_threading_threadcontentionmonitoringsupported
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_5_records_lag
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_0_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_9_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_3_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_6_records_lag_avg
kafka_producer_producer_node_metrics_outgoing_byte_total
kafka_connect_sink_task_metrics_put_batch_avg_time_ms
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_20_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_status_2_records_lag
kafka_producer_producer_metrics_record_error_total
java_lang_memorypool_peakusage_committed
kafka_producer_producer_metrics_io_time_ns_avg
java_lang_memorymanager_valid
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_10_records_lag_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_13_records_lag_max
kafka_producer_producer_metrics_record_retry_rate
kafka_connect_connect_coordinator_metrics_sync_time_max
kafka_producer_producer_metrics_iotime_total
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_status_0_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_status_3_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_22_records_lag_max
kafka_consumer_consumer_fetch_manager_metrics_fetch_latency_avg
kafka_producer_producer_metrics_produce_throttle_time_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_17_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblprevdaysales_0_records_lag_max
java_lang_operatingsystem_totalswapspacesize
kafka_consumer_consumer_coordinator_metrics_join_time_max
java_lang_garbagecollector_lastgcinfo_id
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_14_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_11_records_lag_avg
kafka_connect_connect_worker_rebalance_metrics_rebalance_max_time_ms
kafka_consumer_consumer_metrics_incoming_byte_rate
kafka_connect_sink_task_metrics_offset_commit_seq_no
kafka_connect_connect_metrics_io_time_ns_avg
java_lang_garbagecollector_lastgcinfo_endtime
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_16_records_lag
kafka_producer_producer_metrics_buffer_total_bytes
kafka_consumer_consumer_metrics_io_wait_ratio
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_2_records_lag_max
java_lang_memory_heapmemoryusage_init
java_lang_threading_threadcontentionmonitoringenabled
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_12_records_lag
kafka_connect_sink_task_metrics_sink_record_active_count_avg
kafka_producer_producer_metrics_connection_close_total
kafka_consumer_consumer_node_metrics_incoming_byte_total
kafka_connect_connect_node_metrics_outgoing_byte_total
kafka_producer_producer_metrics_buffer_exhausted_total
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_8_records_lag_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_5_records_lag_max
kafka_connect_connect_metrics_failed_authentication_total
kafka_consumer_consumer_metrics_incoming_byte_total
kafka_consumer_consumer_coordinator_metrics_sync_time_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_6_records_lag_max
kafka_consumer_consumer_metrics_response_total
kafka_consumer_consumer_coordinator_metrics_heartbeat_response_time_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_0_records_lag_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_9_records_lag_max
java_lang_memorypool_collectionusagethresholdexceeded
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_3_records_lag_max
kafka_connect_connect_coordinator_metrics_assigned_tasks
kafka_consumer_consumer_fetch_manager_metrics_records_lag
kafka_producer_producer_metrics_request_latency_avg
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblatm_master_0_records_lag_max
java_lang_operatingsystem_systemcpuload
kafka_connect_connect_metrics_outgoing_byte_total
kafka_connect_connector_task_metrics_offset_commit_success_percentage
kafka_producer_producer_metrics_buffer_exhausted_rate
kafka_consumer_consumer_node_metrics_response_rate
kafka_connect_connect_metrics_response_rate
kafka_consumer_consumer_metrics_network_io_rate
kafka_connect_connect_coordinator_metrics_join_time_avg
kafka_producer_producer_metrics_network_io_total
java_lang_memorypool_usage_init
java_lang_memorypool_collectionusage_max
kafka_consumer_consumer_node_metrics_request_latency_avg
kafka_producer_producer_metrics_produce_throttle_time_avg
kafka_producer_producer_node_metrics_incoming_byte_total
kafka_producer_producer_node_metrics_request_rate
kafka_producer_producer_metrics_record_size_max
kafka_consumer_consumer_fetch_manager_metrics_bytes_consumed_rate
kafka_consumer_consumer_coordinator_metrics_commit_total
java_lang_operatingsystem_processcputime
kafka_connect_sink_task_metrics_sink_record_send_total
java_lang_memory_heapmemoryusage_used
kafka_producer_producer_node_metrics_request_size_max
kafka_connect_connector_task_metrics_running_ratio
kafka_connect_connect_metrics_connection_close_total
kafka_producer_producer_metrics_record_queue_time_avg
kafka_producer_producer_metrics_record_error_rate
kafka_connect_connect_worker_metrics_connector_startup_failure_percentage
kafka_connect_connect_worker_metrics_task_startup_failure_total
java_lang_memorypool_collectionusage_committed
java_lang_memorypool_peakusage_max
kafka_connect_connect_node_metrics_incoming_byte_total
java_lang_classloading_totalloadedclasscount
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_8_records_lag_avg
kafka_connect_connect_node_metrics_request_size_max
kafka_connect_connect_metrics_io_wait_time_ns_avg
kafka_connect_connect_worker_rebalance_metrics_epoch
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_5_records_lag_avg
kafka_connect_connect_metrics_connection_close_rate
kafka_consumer_consumer_coordinator_metrics_sync_time_max
kafka_producer_producer_metrics_successful_authentication_total
java_lang_operatingsystem_freephysicalmemorysize
kafka_consumer_consumer_metrics_connection_close_rate
kafka_consumer_consumer_node_metrics_request_size_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_2_records_lag_avg
kafka_consumer_consumer_coordinator_metrics_join_time_avg
kafka_producer_producer_metrics_buffer_available_bytes
kafka_consumer_consumer_coordinator_metrics_commit_rate
kafka_connect_connector_task_metrics_offset_commit_avg_time_ms
java_lang_garbagecollector_collectiontime
kafka_connect_connect_metrics_io_wait_ratio
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblcollections_0_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_status_4_records_lag_max
kafka_connect_connect_coordinator_metrics_join_total
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_status_1_records_lag_max
java_lang_operatingsystem_systemloadaverage
java_lang_memorypool_peakusage_init
kafka_consumer_consumer_metrics_request_total
java_lang_threading_currentthreadcputime
java_lang_memory_heapmemoryusage_committed
kafka_connect_connect_worker_metrics_task_startup_success_total
kafka_producer_producer_metrics_successful_authentication_rate
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_configs_0_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_status_1_records_lag
kafka_producer_producer_metrics_metadata_age
kafka_connect_connect_metrics_incoming_byte_total
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_status_3_records_lag
kafka_consumer_consumer_coordinator_metrics_join_rate
kafka_consumer_consumer_coordinator_metrics_sync_total
kafka_connect_connect_coordinator_metrics_heartbeat_rate
kafka_connect_connect_metrics_connection_count
kafka_producer_producer_node_metrics_response_total
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_status_2_records_lag_avg
kafka_producer_producer_metrics_select_total
kafka_consumer_consumer_metrics_io_waittime_total
kafka_producer_producer_topic_metrics_record_send_rate
kafka_producer_producer_metrics_waiting_threads
java_lang_memorypool_usagethresholdcount
kafka_producer_producer_metrics_batch_split_total
kafka_consumer_consumer_coordinator_metrics_last_heartbeat_seconds_ago
java_lang_threading_totalstartedthreadcount
java_lang_garbagecollector_lastgcinfo_memoryusageaftergc_init
kafka_consumer_consumer_metrics_io_ratio
kafka_connect_connect_metrics_request_size_avg
java_lang_memorypool_usage_max
java_lang_garbagecollector_lastgcinfo_memoryusageaftergc_max
java_lang_memory_nonheapmemoryusage_used
java_lang_classloading_verbose
kafka_connect_connect_worker_metrics_connector_startup_attempts_total
java_lang_runtime_bootclasspathsupported
java_lang_memorypool_usagethresholdsupported
kafka_consumer_consumer_metrics_network_io_total
kafka_consumer_consumer_coordinator_metrics_assigned_partitions
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_15_records_lag_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_12_records_lag_max
kafka_consumer_consumer_node_metrics_request_total
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_13_records_lag
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_17_records_lag
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_18_records_lag_max
java_lang_compilation_compilationtimemonitoringsupported
kafka_producer_producer_metrics_failed_authentication_rate
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblitemgroup_0_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_fetch_throttle_time_avg
kafka_producer_producer_topic_metrics_byte_total
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_11_records_lag
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_19_records_lag
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_24_records_lag_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_21_records_lag_max
kafka_producer_producer_metrics_io_waittime_total
kafka_connect_connect_metrics_select_total
kafka_producer_producer_metrics_io_wait_ratio
kafka_consumer_consumer_node_metrics_response_total
kafka_consumer_consumer_metrics_connection_creation_rate
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_15_records_lag
java_lang_memorypool_collectionusagethresholdsupported
kafka_producer_producer_metrics_outgoing_byte_rate
kafka_connect_connector_task_metrics_batch_size_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_10_records_lag
kafka_connect_connect_node_metrics_incoming_byte_rate
java_lang_threading_threadcputimeenabled
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_status_0_records_lag_max
java_lang_memorypool_collectionusagethresholdcount
kafka_connect_connect_coordinator_metrics_join_rate
kafka_consumer_consumer_metrics_request_size_avg
java_lang_garbagecollector_lastgcinfo_memoryusagebeforegc_max
kafka_connect_connect_coordinator_metrics_sync_rate
kafka_consumer_consumer_fetch_manager_metrics_fetch_latency_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_status_3_records_lag_max
kafka_connect_connect_metrics_successful_authentication_total
kafka_connect_connect_metrics_successful_authentication_rate
kafka_connect_connect_node_metrics_outgoing_byte_rate
kafka_consumer_consumer_fetch_manager_metrics_fetch_size_avg
java_lang_memory_nonheapmemoryusage_committed
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_21_records_lag_avg
kafka_connect_sink_task_metrics_partition_count
kafka_connect_connect_worker_metrics_connector_startup_failure_total
kafka_producer_producer_metrics_select_rate
kafka_connect_sink_task_metrics_sink_record_active_count
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblitemgroup_0_records_lag
kafka_connect_connect_coordinator_metrics_sync_time_avg
kafka_producer_producer_metrics_compression_rate_avg
kafka_consumer_consumer_metrics_successful_authentication_total
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_configs_0_records_lag_max
kafka_producer_producer_metrics_response_rate
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_1_records_lag_max
kafka_producer_producer_topic_metrics_record_send_total
kafka_connect_connect_node_metrics_request_latency_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_20_records_lag
kafka_consumer_consumer_metrics_outgoing_byte_total
java_lang_memorypool_peakusage_used
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_7_records_lag_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_4_records_lag_max
java_lang_memorypool_collectionusagethreshold
kafka_connect_connect_node_metrics_response_rate
kafka_producer_producer_topic_metrics_record_retry_total
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_24_records_lag
java_lang_garbagecollector_lastgcinfo_starttime
kafka_connect_connect_metrics_io_ratio
kafka_producer_producer_metrics_failed_authentication_total
kafka_producer_producer_topic_metrics_record_error_total
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_21_records_lag
kafka_consumer_kafka_metrics_count_count
kafka_producer_producer_node_metrics_request_latency_avg
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblsubregion_0_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_18_records_lag_avg
kafka_consumer_consumer_metrics_response_rate
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_12_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_15_records_lag_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_24_records_lag_avg
kafka_connect_sink_task_metrics_sink_record_active_count_max
kafka_connect_connect_metrics_response_total
kafka_consumer_consumer_fetch_manager_metrics_fetch_throttle_time_max
kafka_connect_connect_coordinator_metrics_heartbeat_response_time_max
kafka_producer_producer_metrics_request_size_avg
kafka_connect_sink_task_metrics_sink_record_read_rate
kafka_consumer_consumer_fetch_manager_metrics_records_consumed_rate
kafka_producer_producer_node_metrics_request_total
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_7_records_lag
kafka_producer_producer_metrics_connection_close_rate
kafka_producer_producer_metrics_response_total
kafka_consumer_consumer_fetch_manager_metrics_records_consumed_total
kafka_connect_connect_worker_rebalance_metrics_time_since_last_rebalance_ms
java_nio_bufferpool_totalcapacity
kafka_connect_connect_worker_metrics_task_count
kafka_connect_connect_worker_rebalance_metrics_rebalance_avg_time_ms
java_lang_memory_nonheapmemoryusage_max
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_3_records_lag
kafka_connect_sink_task_metrics_sink_record_read_total
kafka_consumer_consumer_metrics_successful_authentication_rate
java_lang_threading_threadcputimesupported
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_status_0_records_lag
kafka_producer_producer_metrics_record_size_avg
kafka_connect_connect_metrics_request_total
kafka_consumer_consumer_fetch_manager_metrics_fetch_total
kafka_connect_connect_metrics_iotime_total
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_status_4_records_lag
kafka_producer_producer_metrics_incoming_byte_total
java_lang_memorypool_usagethreshold
kafka_producer_producer_metrics_request_total
java_lang_memorypool_collectionusage_init
java_nio_bufferpool_count
kafka_connect_connect_coordinator_metrics_join_time_max
kafka_producer_producer_metrics_bufferpool_wait_ratio
kafka_producer_producer_metrics_batch_split_rate
kafka_consumer_consumer_fetch_manager_metrics_in_dataops_tblevent_regionlist_0_records_lag_avg
java_lang_operatingsystem_openfiledescriptorcount
java_lang_memory_heapmemoryusage_max
kafka_consumer_consumer_node_metrics_request_size_avg
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_18_records_lag
kafka_connect_connect_node_metrics_request_total
kafka_consumer_consumer_metrics_failed_authentication_total
java_lang_runtime_starttime
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_configs_0_records_lag
java_lang_threading_threadcount
kafka_consumer_consumer_metrics_request_rate
java_lang_threading_currentthreadcputimesupported
kafka_consumer_consumer_fetch_manager_metrics_validation_engine_connect_offsets_14_records_lag
jmx_scrape_duration_seconds
jmx_scrape_error
jvm_threads_current
jvm_threads_daemon
jvm_threads_peak
jvm_threads_started_total
jvm_threads_deadlocked
jvm_threads_deadlocked_monitor
jvm_classes_loaded
jvm_classes_loaded_total
jvm_classes_unloaded_total
jmx_config_reload_success_total
process_cpu_seconds_total
process_start_time_seconds
process_open_fds
process_max_fds
process_virtual_memory_bytes
process_resident_memory_bytes
jvm_gc_collection_seconds
jvm_memory_bytes_used
jvm_memory_bytes_committed
jvm_memory_bytes_max
jvm_memory_pool_bytes_used
jvm_memory_pool_bytes_committed
jvm_memory_pool_bytes_max
jvm_info
@harshith2801
Copy link

Hi, where can I find descriptions for these metrics

@abhaygitty
Copy link

Hi, where can I find descriptions for these metrics

Absolutely. Not every metric has a unit of measurement that's implicit. And, if self explanatory, for instance, process_virtual_memory_bytes is for sure, a byte count as we can see. Would it be helpful, if we could also understand if it is the bytes used or bytes available to be used or bytes unavailable to be used. Over a span of some time? Or from the beginning of time? This is where a description would come into use, perhaps. Please post a pointer to the description of the above or a subset of the 480 metrics' list. I am looking for a few of them and would be glad to look up if a subset's exists. Thanks in advance.

@jigar1101
Copy link
Author

Hi @harshith2801 @abhaygitty - Even I was not able to find the description of these metrics.
The list is something that I have aggregated and made based on my understanding.

You'll are free to contribute the description against it in case you'll understand the description of metrics based on your usage.

Thanks

@aj84276
Copy link

aj84276 commented Feb 20, 2024

@jigar1101 any idea how can i export all of these from strimzi kafka connect cluster..Saw this example bit confused on it https://github.com/strimzi/strimzi-kafka-operator/blob/main/examples/metrics/kafka-connect-metrics.yaml

@jigar1101
Copy link
Author

@aj84276 You will need to use Prometheus

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment