Skip to content

Instantly share code, notes, and snippets.

@fhussonnois
Created August 13, 2020 19:18
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save fhussonnois/3c1e9e73c5f956ea0d668231a0de35a4 to your computer and use it in GitHub Desktop.
Save fhussonnois/3c1e9e73c5f956ea0d668231a0de35a4 to your computer and use it in GitHub Desktop.
connect-file-pulse-csv-example-00
curl \
-i -X PUT -H "Accept:application/json" \
-H "Content-Type:application/json" http://localhost:8083/connectors/source-csv-filepulse-00/config \
-d '{
"connector.class":"io.streamthoughts.kafka.connect.filepulse.source.FilePulseSourceConnector",
"fs.scan.directory.path":"/tmp/kafka-connect/examples/",
"fs.scan.interval.ms":"10000",
"fs.scan.filters":"io.streamthoughts.kafka.connect.filepulse.scanner.local.filter.RegexFileListFilter",
"file.filter.regex.pattern":".*\\.csv$",
"task.reader.class": "io.streamthoughts.kafka.connect.filepulse.reader.RowFileInputReader",
"offset.strategy":"name",
"skip.headers": "1",
"topic":"musics-filepulse-csv-00",
"internal.kafka.reporter.bootstrap.servers": "broker:29092",
"internal.kafka.reporter.topic":"connect-file-pulse-status",
"fs.cleanup.policy.class": "io.streamthoughts.kafka.connect.filepulse.clean.LogCleanupPolicy",
"tasks.max": 1
}'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment