djpadz
/ aws-docker-login.rb
Created
April 15, 2020 19:08
Log in to a docker repository in AWS ECR using the current profile
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env ruby | |
| # frozen_string_literal: true | |
| require 'json' | |
| require 'base64' | |
| require 'open3' | |
| puts 'Getting authorization token...' | |
| out, status = Open3.capture2 'aws', 'ecr', 'get-authorization-token' |
dsmrt
/ query-aws-logs-insights.bash
Last active
May 9, 2025 14:49
Using AWS CLI to query CloudWatch Logs with Insights. Looking -30 mins to now.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # this script queries aws logs with insights filtering on ERROR | |
| # explanation of start and end times | |
| #--start-time = unix timestamp 30 mins in the past | |
| #--end-time = unix timestamp now | |
| QUERY_ID=$(aws logs start-query \ | |
| --profile $profile \ | |
| --log-group-name /aws/lambda/aap-event-consumer-dev \ | |
| --start-time `date -v-30M "+%s"` \ |
curtismckee
/ aws-12-in-2021.md
Last active
January 27, 2023 01:26
Kulasangar
/ CreateClusterAndSubmitAJob.py
Created
November 4, 2018 18:29
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import boto3 | |
| connection = boto3.client( | |
| 'emr', | |
| region_name='us-east-1', | |
| aws_access_key_id='YOUR ACCESS KEY', | |
| aws_secret_access_key='YOUR SECRET KEY', | |
| ) | |
| cluster_id = connection.run_job_flow( |
MattHealy
/ rotate-ami-launch-config.sh
Created
August 8, 2017 12:43
Update an existing AWS Launch Configuration to use a new AMI image
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| oldconfigname="$1" | |
| newconfigname="$2" | |
| ami="$3" | |
| KEYNAME="my_keypair_name" | |
| ASGROUP="my_autoscaling_group_name" | |
| SECURITYGROUP="sg-1234" | |
| INSTANCETYPE="t2.micro" |
LeCoupa
/ redis_cheatsheet.bash
Last active
October 26, 2025 14:15
Redis Cheatsheet - Basic Commands You Must Know --> UPDATED VERSION --> https://github.com/LeCoupa/awesome-cheatsheets
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Redis Cheatsheet | |
| # All the commands you need to know | |
| redis-server /path/redis.conf # start redis with the related configuration file | |
| redis-cli # opens a redis prompt | |
| # Strings. |
ursuad
/ kafka-cheat-sheet.md
Last active
June 17, 2025 10:00
Quick command reference for Apache Kafka
bin/kafka-topics.sh --zookeeper localhost:2181 --list
bin/kafka-topics.sh --zookeeper localhost:2181 --describe --topic mytopic
bin/kafka-topics.sh --zookeeper localhost:2181 --alter --topic mytopic --config retention.ms=1000
... wait a minute ...
jenschelkopf
/ hot-cloud-swap-script.md
Last active
August 9, 2019 21:05
Cheat Sheet for the FoundationDB 'Hot Cloud Swap' Screencast
Grab the client and server packages from the FoundationDB website
ansible -i inventory digital_ocean -a "wget https://foundationdb.com/downloads/f-nbxofdxnoxocd/I_accept_the_FoundationDB_Community_License_Agreement/key-value-store/2.0.9/foundationdb-clients_2.0.9-1_amd64.deb https://foundationdb.com/downloads/f-nbxofdxnoxocd/I_accept_the_FoundationDB_Community_License_Agreement/key-value-store/2.0.9/foundationdb-server_2.0.9-1_amd64.deb"
Install the client and server packages
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Producer | |
| Setup | |
| bin/kafka-topics.sh --zookeeper esv4-hcl197.grid.linkedin.com:2181 --create --topic test-rep-one --partitions 6 --replication-factor 1 | |
| bin/kafka-topics.sh --zookeeper esv4-hcl197.grid.linkedin.com:2181 --create --topic test --partitions 6 --replication-factor 3 | |
| Single thread, no replication | |
| bin/kafka-run-class.sh org.apache.kafka.clients.tools.ProducerPerformance test7 50000000 100 -1 acks=1 bootstrap.servers=esv4-hcl198.grid.linkedin.com:9092 buffer.memory=67108864 batch.size=8196 |
NewerOlder