Skip to content

Instantly share code, notes, and snippets.

Created August 24, 2017 16:55
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save anonymous/5a557791125bf053a389c3bbb24883d2 to your computer and use it in GitHub Desktop.
Save anonymous/5a557791125bf053a389c3bbb24883d2 to your computer and use it in GitHub Desktop.
WorkerConfig.properties, configSource.properties, configSink.properties
name=CPSConnector
connector.class=com.google.pubsub.kafka.sink.CloudPubSubSinkConnector
tasks.max=1
#Not sure if I should share this info so I stared it out, but its correct
cps.topic=****-******
cps.project=****-***-*******
name=CPSConnector
connector.class=com.google.pubsub.kafka.source.CloudPubSubSourceConnector
tasks.max=1
kafka.topic= test
# These are defaults. This file just demonstrates how to override some settings.
bootstrap.servers=localhost:2181
# The converters specify the format of data in Kafka and how to translate it into Connect data. Every Connect user will
# need to configure these based on the format they want their data in when loaded from or stored into Kafka
key.converter=org.apache.kafka.connect.json.JsonConverter
value.converter=org.apache.kafka.connect.json.JsonConverter
# The internal converter used for offsets and config data is configurable and must be specified, but most users will
# always want to use the built-in default. Offset and config data is never visible outside of Copcyat in this format.
internal.key.converter=org.apache.kafka.connect.json.JsonConverter
internal.value.converter=org.apache.kafka.connect.json.JsonConverter
key.converter.schemas.enable=true
value.converter.schemas.enable=true
#C:\confluent-3.3.0\share\java\kafka-connect-pubsub
plugin.path=\share\java\kafka\kafka-connect-pubsub
offset.storage.file.filename=/tmp/connect.offsets
# Flush much faster than normal, which is useful for testing/debugging
offset.flush.interval.ms=10000
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment