Skip to content

Instantly share code, notes, and snippets.

@mgoodness
mgoodness / fluentd-config.yaml
Last active April 7, 2019 04:47
Fluentd configuration for shipping systemd & Kubernetes logs to CloudWatch Logs
---
kind: ConfigMap
apiVersion: v1
metadata:
labels:
app: fluentd
name: fluentd-cloudwatch-logs
namespace: kube-system
data:
aws-region: us-east-1
@ashrithr
ashrithr / kafka.md
Last active March 14, 2024 21:16
kafka introduction

Introduction to Kafka

Kafka acts as a kind of write-ahead log (WAL) that records messages to a persistent store (disk) and allows subscribers to read and apply these changes to their own stores in a system appropriate time-frame.

Terminology:

  • Producers send messages to brokers
  • Consumers read messages from brokers
  • Messages are sent to a topic