Skip to content

Instantly share code, notes, and snippets.

start string producer with below command
kafka-console-producer.bat \ --broker-list broker-host:9091 --topic test --property "parse.key=true" --property "key.separator=:"
It will start producer and we can type message as below (key:value)
1:{ "PROGRAM_NAME": "NDTV", "ORIGINATOR": "JADE_FEVER", "channel": "CTV Drama+","weekday": "Monday", "DATE": "9/28/2018", "START_TIME": "17:30:00"}
@mduhan
mduhan / SetKafkaConsumergroupOffset.java
Created August 18, 2018 14:09
Java code to update Consumer group offset
package com.operative.pipelinetracker.controller;
import java.util.HashMap;
import java.util.Map;
import java.util.Properties;
import org.apache.kafka.clients.consumer.KafkaConsumer;
import org.apache.kafka.clients.consumer.OffsetAndMetadata;
import org.apache.kafka.common.TopicPartition;
import org.apache.kafka.common.serialization.StringDeserializer;
@mduhan
mduhan / kafka-commands-sheet.md
Created August 18, 2018 14:07
Kafka command

Kafka Topics

List existing topics

bin/kafka-topics.sh --zookeeper localhost:2181 --list

Describe a topic

bin/kafka-topics.sh --zookeeper localhost:2181 --describe --topic mytopic

Purge a topic

bin/kafka-topics.sh --zookeeper localhost:2181 --alter --topic mytopic --config retention.ms=1000

... wait a minute ...