Skip to content

Instantly share code, notes, and snippets.

@ngollperrier

ngollperrier/kafka-connect-leboncoin-config-example-part-02.json

Created April 23, 2021 16:59
Show Gist options
  • Save ngollperrier/f70a07c9d6ebd471644512de1d88963e to your computer and use it in GitHub Desktop.
Save ngollperrier/f70a07c9d6ebd471644512de1d88963e to your computer and use it in GitHub Desktop.
Download ZIP
Raw
kafka-connect-leboncoin-config-example-part-02.json
"topics": "leboncoin_staging_ads_ad-publications_public_avro",
"s3.bucket.name": "leboncoin_kafka_events_bucket",
"topics.dir": "staging/topics/ads/raw/parquet",
"storage.class": "io.confluent.connect.s3.storage.S3Storage",
"format.class": "io.confluent.connect.s3.format.parquet.ParquetFormat",
"path.format": "'schema_version'=VV/'event_date'=YYYY-MM-dd/'event_hour'=HH",
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment