Skip to content

Instantly share code, notes, and snippets.

@WonderBeat
Created November 26, 2019 15:41
Show Gist options
  • Save WonderBeat/4537d5ebe504d3116faa137857807a30 to your computer and use it in GitHub Desktop.
Save WonderBeat/4537d5ebe504d3116faa137857807a30 to your computer and use it in GitHub Desktop.
connector.class=com.github.jcustenborder.kafka.connect.spooldir.SpoolDirCsvSourceConnector
csv.first.row.as.header=false
finished.path=/tmp/spooldir_finished
tasks.max=1
halt.on.error=true
schema.generation.enabled=false
value.converter.schema.registry.url=https://ip-10-0-0-24.eu-west-1.compute.internal:8481,https://ip-10-0-0-25.eu-west-1.compute.internal:8481
input.file.pattern=.*.csv
name=direct-mail-csv
topic=csv-test
error.path=/tmp/
input.path=/tmp/
value.converter=io.confluent.connect.avro.AvroConverter
key.converter=io.confluent.connect.avro.AvroConverter
key.converter.schema.registry.url=https://ip-10-0-0-24.eu-west-1.compute.internal:8481,https://ip-10-0-0-25.eu-west-1.compute.internal:8481
key.schema=TODO!!
value.schema=TODO!!
transforms=eventdatetime, tokeneffectivedate, tokenexpirationdate, offereffectivedate, offerexpirationdate, sendoutdateplanned
transforms.eventdatetime.type=org.apache.kafka.connect.transforms.TimestampConverter$Value
transforms.eventdatetime.target.type=unix
transforms.eventdatetime.format= "yyyy-MM-dd"
transforms.eventdatetime.field=EventDateTime
transforms.tokeneffectivedate.type=org.apache.kafka.connect.transforms.TimestampConverter$Value
transforms.tokeneffectivedate.target.type=unix
transforms.tokeneffectivedate.format= "yyyy-MM-dd"
transforms.tokeneffectivedate.field=TokenEffectiveDate
transforms.tokenexpirationdate.type=org.apache.kafka.connect.transforms.TimestampConverter$Value
transforms.tokenexpirationdate.target.type=unix
transforms.tokenexpirationdate.format= "yyyy-MM-dd"
transforms.tokenexpirationdate.field=TokenExpirationDate
transforms.offereffectivedate.type=org.apache.kafka.connect.transforms.TimestampConverter$Value
transforms.offereffectivedate.target.type=unix
transforms.offereffectivedate.format= "yyyy-MM-dd"
transforms.offereffectivedate.field=OfferEffectiveDate
transforms.offerexpirationdate.type=org.apache.kafka.connect.transforms.TimestampConverter$Value
transforms.offerexpirationdate.target.type=unix
transforms.offerexpirationdate.format= "yyyy-MM-dd"
transforms.offerexpirationdate.field=OfferExpirationDate
transforms.sendoutdateplanned.type=org.apache.kafka.connect.transforms.TimestampConverter$Value
transforms.sendoutdateplanned.target.type=unix
transforms.sendoutdateplanned.format= "yyyy-MM-dd"
transforms.sendoutdateplanned.field=SendoutDatePlanned
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment