Skip to content

Instantly share code, notes, and snippets.

View arnecls's full-sized avatar

Arne Claus arnecls

View GitHub Profile
@arnecls
arnecls / delete_custom_metrics.py
Last active February 4, 2022 19:12 — forked from jeffadams/delete_custom_metrics.py
script to delete all custom metrics from a stackdriver account
#!/usr/bin/env python
from google.cloud import monitoring_v3
'''
Requires you to be logged in via `gcloud auth application-default login`.
'''
project_id = 'my-project-id' # change project id here
metrics_prefix = 'custom.googleapis.com'
@arnecls
arnecls / logstash2elastic.conf
Last active August 29, 2015 14:21
logstash2elastic.conf
input
{
kafka
{
zk_connect => "10.2.3.240:2181/stream/kafka/de"
codec => plain
topic_id => "mmbb"
consumer_threads => 1
reset_beginning => true
}
@arnecls
arnecls / hekakafka2file.toml
Last active August 29, 2015 14:20
Heka Kafka to file
[hekad]
maxprocs = 32
[Kafka]
type = "KafkaInput"
topic = "mmbb"
addrs = ["kafka0:9092","kafka1:9092","kafka2:9092"]
decoder = "AccesslogDecoder"
offset_method = "Oldest"
@arnecls
arnecls / kafka2el.conf
Created April 30, 2015 13:57
Gollum Kafka to Elasticsearch
- "consumer.Kafka":
Enable: true
Topic: "mmbb"
DefaultOffset: "Oldest"
Stream: "kafka"
Servers:
- "kafka0:9092"
- "kafka1:9092"
- "kafka2:9092"
@arnecls
arnecls / hekakafka2file.toml
Last active August 29, 2015 14:20
Heka Kafka to file
[hekad]
maxprocs = 8
[Kafka]
type = "KafkaInput"
topic = "mmbb"
addrs = ["kafka0:9092","kafka1:9092","kafka2:9092"]
decoder = "AccesslogDecoder"
offset_method = "Oldest"
@arnecls
arnecls / logstashk2f.conf
Last active August 29, 2015 14:20
Logstash Kafka to file
input
{
kafka
{
zk_connect => "zookeeper:2181/stream/kafka/de"
codec => plain
topic_id => "mmbb"
consumer_threads => 1
reset_beginning => true
}
@arnecls
arnecls / kafkafile.conf
Created April 30, 2015 13:51
Gollum Kafka to file
- "consumer.Kafka":
Enable: true
Topic: "mmbb"
DefaultOffset: "Oldest"
Stream: "kafka"
Servers:
- "kafka0:9092"
- "kafka1:9092"
- "kafka2:9092"
@arnecls
arnecls / peakfile.conf
Created April 30, 2015 12:31
Gollum peak file performance config
- "consumer.Profiler":
Runs: 100000
Batches: 100
Characters: "abcdefghijklmnopqrstuvwxyz ABCDEFGHIJKLMNOPQRSTUVWXYZ .,!;:-_"
Message: "%256s"
Stream: "profile"
- "producer.File":
Channel: 65535
Formatter: "format.Envelope"
@arnecls
arnecls / peakmem.conf
Created April 30, 2015 12:29
Gollum peak performance config
- "consumer.Profiler":
Runs: 100000
Batches: 100
Characters: "abcdefghijklmnopqrstuvwxyz ABCDEFGHIJKLMNOPQRSTUVWXYZ .,!;:-_"
Message: "%256s"
Stream: "profile"
- "producer.Null":
Stream: "profile"