Skip to content

Instantly share code, notes, and snippets.

@tbondarchuk
Created November 16, 2021 18:48
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save tbondarchuk/69bf11730cd614d1660ed4ef3429a51e to your computer and use it in GitHub Desktop.
Save tbondarchuk/69bf11730cd614d1660ed4ef3429a51e to your computer and use it in GitHub Desktop.
Vector values for ALB S3 Logs
role: "Stateless-Aggregator"
replicas: 1
serviceAccount:
create: true
annotations:
eks.amazonaws.com/role-arn: <ARN>
env:
- name: SQS_QUEUE_URL
value: <SQS_QUEUE_URL>
- name: AWS_REGION
value: <AWS_REGION>
service:
enabled: false
customConfig:
data_dir: /vector-data-dir
api:
enabled: true
address: '0.0.0.0:8686'
playground: false
log_schema:
host_key: host
message_key: message
source_type_key: source_type
timestamp_key: timestamp
sources:
s3_alb_logs:
compression: gzip
region: '${AWS_REGION}'
type: aws_s3
sqs:
queue_url: '${SQS_QUEUE_URL}'
transforms:
alb_logs:
inputs:
- s3_alb_logs
source: ' . = parse_aws_alb_log!(.message)'
type: remap
sinks:
loki:
endpoint: 'http://loki:3100'
inputs:
- alb_logs
type: loki
encoding:
codec: json
labels:
event: |-
{{ print "{{ event_field }}" }}
forwarder: vector
source: alb_logs
livenessProbe:
httpGet:
path: /health
port: api
readinessProbe:
httpGet:
path: /health
port: api
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment