Connect FilePulse | Connect Spooldir | Connect FileStreams | |
---|---|---|---|
Connector Type | source | source | source / sink |
License | Apache License 2.0 | Apache License 2.0 | Apache License 2.0 |
Available on Confluent Hub | YES | YES | YES |
Docker image | YES | NO | NO |
Delivery semantics | At-least-once | At-least-once | At-most-once |
Usable in production | YES | YES | NO |
Supported file formats(out-of-the box) | Delimited, Binary, JSON, Avro, XML (limited) | Delimited, JSON | Text file |
Source partitions | Configurable (filename, path, filename+hash) | filename | filename |
Support for distributed mode (multi-tasks) | YES (requires a shared volume) | NO | NO |
Support for streaming log files | YES | NO | YES |
Support for transformation | Single Message Transforms, Filters (Grok, Append, JSON, etc) | Single Message Transforms | Single Message Transforms |
Support for tracking processing progress of files | YES (using an internal topic) | NO | NO |
Last active
January 24, 2020 11:57
-
-
Save fhussonnois/af1cc2dcdcf588312b3d8c9ad5890239 to your computer and use it in GitHub Desktop.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment