Skip to content

Instantly share code, notes, and snippets.

@wpcarro
Created February 12, 2023 21:57
Show Gist options
  • Save wpcarro/3badd432f178d935dc04e2337f57505a to your computer and use it in GitHub Desktop.
Save wpcarro/3badd432f178d935dc04e2337f57505a to your computer and use it in GitHub Desktop.
benthos definition to backfill one year's worth of logs
http:
enabled: false
input:
file:
paths:
- /tmp/errors.json
codec: all-bytes
processors:
- unarchive:
format: json_array
output:
broker:
batching:
count: 10
processors:
- archive:
format: json_array
- sleep:
duration: 1s
outputs:
- stdout:
codec: lines
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment