Skip to content

Instantly share code, notes, and snippets.

@VAdamec
Last active August 29, 2015 13:57
Show Gist options
  • Save VAdamec/9387924 to your computer and use it in GitHub Desktop.
Save VAdamec/9387924 to your computer and use it in GitHub Desktop.
Logstash grok for CloudTrail
#
# Cloudtrail
#
grep {
tags => ["awsaudit"]
add_tag => ["awsauditproc"]
}
grok {
tags => ["awsauditproc"]
match => [ "@message", "\"eventVersion\":\"%{GREEDYDATA:eventVersion}\",\"errorCode\":\"%{GREEDYDATA:errorCode}\",\"eventTime\":\"%{GREEDYDATA:eventTime}\",\"requestParameters\":\"%{GREEDYDATA:requestParameters}\",\"errorMessage\":\"%{GREEDYDATA:errorMessage}\",\"responseElements\":\"%{GREEDYDATA:responseElements}\",\"eventName\":\"%{GREEDYDATA:eventName}\",\"userIdentity\":\"%{GREEDYDATA:userIdentity}\",\"eventSource\":\"%{GREEDYDATA:eventSource}\",\"userAgent\":\"%{GREEDYDATA:userAgent}\",\"sourceIPAddress\":\"%{GREEDYDATA:sourceIPAddress}\""]
add_tag => ["awsaudit-match"]
remove_tag => ["awsauditproc"]
}
grok {
tags => ["awsauditproc"]
match => [ "@message", "\"eventVersion\":\"%{GREEDYDATA:eventVersion}\",\"errorCode\":\"%{GREEDYDATA:errorCode}\",\"eventTime\":\"%{GREEDYDATA:eventTime}\",\"requestParameters\":\"%{GREEDYDATA:requestParameters}\",\"errorMessage\":\"%{GREEDYDATA:errorMessage}\",\"responseElements\":\"%{GREEDYDATA:responseElements}\",\"eventName\":\"%{GREEDYDATA:eventName}\",\"userIdentity%{GREEDYDATA}userName\'\:\su\'%{GREEDYDATA:userIdentity}\'\,\su\'type%{GREEDYDATA}eventSource\":\"%{GREEDYDATA:eventSource}\",\"userAgent\":\"%{GREEDYDATA:userAgent}\",\"sourceIPAddress\":\"%{GREEDYDATA:sourceIPAddress}\"" ]
add_tag => ["awsaudit-match-a"]
remove_tag => ["awsauditproc"]
}
grok {
tags => ["awsauditproc"]
match => [ "@message", "\"eventVersion\":\"%{GREEDYDATA:eventVersion}\",\"eventTime\":\"%{GREEDYDATA:eventTime}\",\"requestParameters\":\"%{GREEDYDATA:requestParameters}\"responseElements\":\"%{GREEDYDATA:responseElements}\",\"eventName\":\"%{GREEDYDATA:eventName}\",\"userIdentity\":\"\{u\'userName\'\:\su'%{GREEDYDATA:userIdentity}\'\,\su\'principalId%{GREEDYDATA}eventSource\":\"%{GREEDYDATA:eventSource}\",\"userAgent\":\"%{GREEDYDATA:userAgent}\",\"sourceIPAddress\":\"%{GREEDYDATA:sourceIPAddress}\"" ]
add_tag => ["awsaudit-match-b"]
remove_tag => ["awsauditproc"]
}
@VAdamec
Copy link
Author

VAdamec commented Mar 6, 2014

Just simple&stupid parsing, more precise version will be done later

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment