Skip to content

Instantly share code, notes, and snippets.

@fhussonnois
Last active January 24, 2020 11:57
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save fhussonnois/af1cc2dcdcf588312b3d8c9ad5890239 to your computer and use it in GitHub Desktop.
Save fhussonnois/af1cc2dcdcf588312b3d8c9ad5890239 to your computer and use it in GitHub Desktop.
Connect FilePulse Connect Spooldir Connect FileStreams
Connector Type source source source / sink
License Apache License 2.0 Apache License 2.0 Apache License 2.0
Available on Confluent Hub YES YES YES
Docker image YES NO NO
Delivery semantics At-least-once At-least-once At-most-once
Usable in production YES YES NO
Supported file formats(out-of-the box) Delimited, Binary, JSON, Avro, XML (limited) Delimited, JSON Text file
Source partitions Configurable (filename, path, filename+hash) filename filename
Support for distributed mode (multi-tasks) YES (requires a shared volume) NO NO
Support for streaming log files YES NO YES
Support for transformation Single Message Transforms, Filters (Grok, Append, JSON, etc) Single Message Transforms Single Message Transforms
Support for tracking processing progress of files YES (using an internal topic) NO NO
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment