rmoff

This is a series of gists documenting testing done with the numeric.mapping option in Kafka Connect.

• Oracle
• MS SQL Server
• Postgres
• MySQL - n/a because of #563

—@rmoff January 9, 2019

rmoff

---
version: '2'
services:
  zookeeper:
    image: confluentinc/cp-zookeeper:latest
    environment:
      ZOOKEEPER_CLIENT_PORT: 2181
      ZOOKEEPER_TICK_TIME: 2000

  kafka:

rmoff

curl -s "http://localhost:8083/connectors"| \
  jq '.[]'| \
  xargs -I{connector_name} curl -s "http://localhost:8083/connectors/"{connector_name}"/status" | \
  jq -c -M '[.name,.connector.state,.tasks[].state]|join(":|:")' | \
  column -s : -t | \
  sed 's/\"//g' | \
  sort

rmoff

rmoff

Configuring Kafka Connect with Confluent Cloud

So you want to connect Kafka Connect to Confluent Cloud? Here’s how.

Overview

1. Configure the worker

2. Pre-create any topics that your source connector will write to (since auto-topic creation is not enabled on Confluent Cloud)

rmoff

⚠️ ⚠️ This gist is superseded by tabular-io/docker-spark-iceberg#76.

rmoff

rmoff

rmoff

rmoff: mac regex replace in file from CLI

Raycast AI: You can use the sed command on macOS to perform a regex replacement in a file from the command line. Here's the general syntax:

sed 's/regex/replacement/g' input_file > output_file

• regex: The regular expression you want to search for.
• replacement: The text you want to replace the matched regex with.

rmoff

See documentation here