Skip to content

Instantly share code, notes, and snippets.

What would you like to do?
# establish an interactive session with the spark container
KAFKA_CONTAINER=$(docker container ls --filter name=streaming-stack_kafka.1 --format "{{.ID}}")
docker exec -it ${KAFKA_CONTAINER} bash
# set environment variables used by jobs
export BOOTSTRAP_SERVERS="localhost:9092"
export TOPIC_PRODUCTS="demo.products"
export TOPIC_PURCHASES="demo.purchases"
export TOPIC_INVENTORIES="demo.inventories"
# list topics --list --bootstrap-server $BOOTSTRAP_SERVERS
# read topics from beginning \
--topic $TOPIC_PRODUCTS --from-beginning \
--bootstrap-server $BOOTSTRAP_SERVERS \
--topic $TOPIC_PURCHASES --from-beginning \
--bootstrap-server $BOOTSTRAP_SERVERS \
--topic $TOPIC_INVENTORIES --from-beginning \
--bootstrap-server $BOOTSTRAP_SERVERS
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment