Skip to content

Instantly share code, notes, and snippets.

@y-ken
Last active August 29, 2015 14:03
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save y-ken/3546767001fb8bf52ed6 to your computer and use it in GitHub Desktop.
Save y-ken/3546767001fb8bf52ed6 to your computer and use it in GitHub Desktop.
I'd like to make a common name for each Fluentd role.

Name

  • Fluentd Cluster ... whole of fluentd system
  • Fluentd Node ... type of role
  • Fluentd Instance ... each fluentd process

Role

  1. Forwarder ... forwarding log to Aggregator node
  2. Aggregator ... Aggregate log from forwarder node
  3. Proceccer ... Processing or filter records node
  4. Watcher ... Detecting specific pattern and notify node

Diagram

+-----------+                                           +-----------+
| Forwarder +--+      +---------------------+        +--+ Processor |
+-----------+  +------+ Aggregator(Active)  | +------+  +-----------+
+-----------+  |      +---------------------+        |               
| Forwarder +--+                                     |  +-----------+
+-----------+  |      +---------------------+        +--+  Watcher  |
+-----------+  |      | Aggregator(Standby) |           +-----------+
| Forwarder +--+      +---------------------+                        
+-----------+
@kiyoto
Copy link

kiyoto commented Jun 27, 2014

  • s/Proceccer/Processor/
  • I am not 100% sure about the diagram: Are processors/watchers always different from aggregators/forwarders? I can easily imagine a forwarder also being a processor and aggregator being a watcher.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment