Skip to content

Instantly share code, notes, and snippets.

@TinLe
TinLe / curator-output
Created June 26, 2015 00:15
curator v3.2.0 delete indices output
$ curator --port 9217 --timeout 900 delete indices --timestring "%Y.%m.%d" --older-than 7 --time-unit days
2015-06-25 16:54:49,038 INFO Job starting: delete indices
2015-06-25 16:54:49,628 INFO Pruning Kibana-related indices to prevent accidental deletion.
2015-06-25 16:54:49,628 WARNING Very large list of indices. Breaking it up into smaller chunks.
2015-06-25 16:54:49,629 INFO Deleting indices as a batch operation:
2015-06-25 16:54:49,629 INFO ---deleting index dc1_fm-log_event-2015.06.12
2015-06-25 16:54:49,629 INFO ---deleting index dc1_fm-log_event-2015.06.13
2015-06-25 16:54:49,629 INFO ---deleting index dc1_fm-log_event-2015.06.14
2015-06-25 16:54:49,629 INFO ---deleting index dc1_fm-log_event-2015.06.15
2015-06-25 16:54:49,629 INFO ---deleting index dc1_fm-log_event-2015.06.16
@TinLe
TinLe / logstash.conf
Last active March 26, 2021 17:47
my logstash.conf file for postfix
input {
file {
path => "/var/log/maillog*"
exclude => "*.gz"
start_position => "beginning"
type => "maillog"
}
}
filter {
if [type] == "maillog" {
@TinLe
TinLe / maillog.json
Created June 20, 2015 00:16
maillog elasticsearch mapping template
{
"template" : "maillog-*",
"order" : 1,
"settings" : {
"number_of_shards" : 2,
"index.refresh_interval" : "90s"
},
"mappings" : {
"maillog" : {
"properties" : {
@TinLe
TinLe / postfix
Last active October 1, 2020 09:42
postfix grok patterns for logstash
# Syslog stuff
COMPONENT ([\w._\/%-]+)
COMPID postfix\/%{COMPONENT:component}(?:\[%{NUMBER:pid}\])?
POSTFIX (?:%{SYSLOGTIMESTAMP:timestamp}|%{TIMESTAMP_ISO8601:timestamp8601}) (?:%{SYSLOGFACILITY} )?%{SYSLOGHOST:logsource} %{COMPID}:
# Milter
HELO (?:\[%{IP:helo}\]|%{HOST:helo}|%{DATA:helo})
MILTERCONNECT %{QUEUEID:qid}: milter-reject: CONNECT from %{RELAY:relay}: %{GREEDYDATA:milter_reason}; proto=%{WORD:proto}
MILTERUNKNOWN %{QUEUEID:qid}: milter-reject: UNKNOWN from %{RELAY:relay}: %{GREEDYDATA:milter_reason}; proto=%{WORD:proto}
@TinLe
TinLe / ls-config1
Created April 9, 2015 21:33
logstash perf test config
=============================================================================
# logstash v1.5.0rc3
input {
stdin {}
}
output {
kafka {
broker_list => "kafka-server:10251"