Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save aleksandersumowski/e0e4bbeb20abae76c064 to your computer and use it in GitHub Desktop.
Save aleksandersumowski/e0e4bbeb20abae76c064 to your computer and use it in GitHub Desktop.
from transit.reader import Reader
from kafka import KafkaConsumer
from StringIO import StringIO
topic = ''
kafka_brokers = []
consumer = KafkaConsumer(topic,
group_id='my_group',
bootstrap_servers=kafka_brokers,
auto_offset_reset='largest')
reader = Reader("json")
for message in consumer:
print("%s:%d:%d: key=%s value=%s" % (message.topic, message.partition, message.offset, message.key, reader.read(StringIO(message.value))))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment