Skip to content

Instantly share code, notes, and snippets.

@lucamolteni
Last active November 4, 2021 15:34
Show Gist options
  • Save lucamolteni/6a2913c40700197eec65274581635168 to your computer and use it in GitHub Desktop.
Save lucamolteni/6a2913c40700197eec65274581635168 to your computer and use it in GitHub Desktop.
Steps to create a managed connector and interact with it with kcat

Use the _kafka_supporting user! in my case lmolteni_kafka_supporting on console.redhat.com

rhoas login
rhoas kafka list
rhoas kafka create --name=lucamolteni-managedconnector
rhoas kafka describe

wait for the kafka instance to be ready

rhoas service-account list

rhoas service-account create --output-file=./service-acct-credentials.json --file-format=json --overwrite --short-description= lucamolteni-managedconnector-serviceaccount

rhoas service-account list | grep lucamolteni-managedconnector-serviceaccount

export SERVICEACCOUNT=$(cat ./service-acct-credentials.json | jq -r '.clientID')

rhoas kafka acl grant-access --consumer --producer \
--service-account $SERVICEACCOUNT --topic-prefix slacktopic  --group all

export BOOTSTRAPSERVER=$(rhoas kafka describe --name=lucamolteni-managedconnector | jq -r '.bootstrap_server_host')

export PASSWORD=$(cat ./service-acct-credentials.json | jq -r '.clientSecret')

rhoas kafka topic create --name=slacktopic

Now go on the managed connector staging area (VPN) and create a sink connector using the same service account created before due to MGDSTRM-6181

Consumer

kcat -t slacktopic -b "$BOOTSTRAPSERVER" \
-X security.protocol=SASL_SSL -X sasl.mechanisms=PLAIN \
-X sasl.username="$SERVICEACCOUNT" \
-X sasl.password="$PASSWORD" -C

Producer

kcat -t slacktopic -b "$BOOTSTRAPSERVER" \
-X security.protocol=SASL_SSL -X sasl.mechanisms=PLAIN \
-X sasl.username="$SERVICEACCOUNT" \
-X sasl.password="$PASSWORD" -P
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment