Skip to content

Instantly share code, notes, and snippets.

View trink's full-sized avatar

Mike Trinkala trink

  • Trink
  • Half Moon Bay, CA
View GitHub Profile
@trink
trink / s3_upload.sh
Created February 21, 2018 20:35
S3 Uploader for Hindsight Output
#!/bin/bash
export s3_bucket="$1"
export concurrent_jobs="$2"
export use_compression="$3"
export s3_buffer_dirs="${@:4}"
export STORAGE_CLASS="STANDARD"
function upload_file () {
cmd="$1"
set -x

Getting Started (writing your first Analysis Plugin)

Creating an analysis plugin consists of three steps:

  1. Writing a message matcher

    The message matcher allows one to select specific data from the data stream.

  2. Writing the analysis code/business logic