Skip to content

Instantly share code, notes, and snippets.

@jcustenborder
Last active April 2, 2018 17:56
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jcustenborder/bb62d626ae6e8fe747bf1adc1449e83d to your computer and use it in GitHub Desktop.
Save jcustenborder/bb62d626ae6e8fe747bf1adc1449e83d to your computer and use it in GitHub Desktop.
Example docker-compose.yml for the Confluent Platform.

Introduction

This is an example docker-compose.yml for the Confluent Platform.

Networking

In order to properly use this docker-compose make sure that your containers are resolvable by their container name. Take a look at the hosts file. Each container must be resolvable from the host machine if you are connecting from the host to the docker environment.

version: "2"
services:
zookeeper:
image: confluentinc/cp-zookeeper:4.0.0-3
environment:
ZOOKEEPER_CLIENT_PORT: "2181"
ZOOKEEPER_TICK_TIME: "2000"
kafka:
image: confluentinc/cp-enterprise-kafka:4.0.0-3
depends_on:
- zookeeper
environment:
KAFKA_CLUSTER_ID: demo
KAFKA_ZOOKEEPER_CONNECT: "zookeeper:2181"
KAFKA_ADVERTISED_LISTENERS: "PLAINTEXT://:9092"
KAFKA_METRIC_REPORTERS: io.confluent.metrics.reporter.ConfluentMetricsReporter
KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1
CONFLUENT_METRICS_REPORTER_BOOTSTRAP_SERVERS: kafka:9092
CONFLUENT_METRICS_REPORTER_ZOOKEEPER_CONNECT: zookeeper:2181
CONFLUENT_METRICS_REPORTER_TOPIC_REPLICAS: 1
CONFLUENT_METRICS_REPORTER_PUBLISH_MS: 1000
schema-registry:
image: confluentinc/cp-schema-registry:4.0.0-3
environment:
SCHEMA_REGISTRY_KAFKASTORE_CONNECTION_URL: "zookeeper:2181"
SCHEMA_REGISTRY_HOST_NAME: schema-registry
depends_on:
- zookeeper
connect:
image: confluentinc/cp-kafka-connect:4.0.0-3
depends_on:
- schema-registry
- zookeeper
- kafka
- control_center
environment:
CONNECT_BOOTSTRAP_SERVERS: "kafka:9092"
CONNECT_ZOOKEEPER_CONNECT: "zookeeper:2181"
CONNECT_REST_ADVERTISED_HOST_NAME: connect
CONNECT_GROUP_ID: connect
CONNECT_KEY_CONVERTER: io.confluent.connect.avro.AvroConverter
CONNECT_KEY_CONVERTER_SCHEMA_REGISTRY_URL: http://schema-registry:8081
CONNECT_VALUE_CONVERTER: io.confluent.connect.avro.AvroConverter
CONNECT_VALUE_CONVERTER_SCHEMA_REGISTRY_URL: http://schema-registry:8081
CONNECT_CONFIG_STORAGE_TOPIC: _connect_config
CONNECT_OFFSET_STORAGE_TOPIC: _connect_offset
CONNECT_STATUS_STORAGE_TOPIC: _connect_status
CONNECT_INTERNAL_KEY_CONVERTER: org.apache.kafka.connect.json.JsonConverter
CONNECT_INTERNAL_VALUE_CONVERTER: org.apache.kafka.connect.json.JsonConverter
CONNECT_INTERNAL_KEY_CONVERTER_SCHEMAS_ENABLE: 'false'
CONNECT_INTERNAL_VALUE_CONVERTER_SCHEMAS_ENABLE: 'false'
CONNECT_CONFIG_STORAGE_REPLICATION_FACTOR: 1
CONNECT_OFFSET_STORAGE_REPLICATION_FACTOR: 1
CONNECT_STATUS_STORAGE_REPLICATION_FACTOR: 1
control_center:
image: confluentinc/cp-enterprise-control-center:4.0.0-3
depends_on:
- zookeeper
- kafka
ports:
- "9021:9021"
environment:
CONTROL_CENTER_BOOTSTRAP_SERVERS: "kafka:9092"
CONTROL_CENTER_ZOOKEEPER_CONNECT: "zookeeper:2181"
CONTROL_CENTER_CONNECT_CLUSTER: 'connect:8083'
CONTROL_CENTER_REPLICATION_FACTOR: 1
127.0.0.1 zookeeper
127.0.0.1 kafka
127.0.0.1 schema-registry
127.0.0.1 connect
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment