peacengell

Use AWS CLI and jq to do some things

I'm just getting up to speed on AWS, and so I'm learning my way around the CLI. It's nice and easy to do lots of things from the CLI, like querying, creating and destroying instances and images. There are lots of fiddly bits involved in parsing output so it can be used by a script or something, though, so here are some notes.

Tools

AWS CLI

Obviously you need the AWS CLI. It's an easy install using pip. Go here to find documentation and other install methods.

peacengell

wget http://stedolan.github.io/jq/download/linux64/jq 
aws ec2 describe-instances --filters "Name=tag:Name,Values=$NAME" \
  "Name=instance-state-name,Values=running" \
  |  jq -r \
  ".Reservations[] | .Instances[] | .InstanceId" \

aws ec2 describe-volumes --filters \
  "Name=status,Values=available" \
  | jq -r ".Volumes[] | .VolumeId" \

peacengell

{"lastUpload":"2018-01-22T06:51:54.064Z","extensionVersion":"v2.8.7"}

peacengell

Git Tips and tricks

---

01 - list you git configuration

thieryl@thieryl[09:52:44]: $ git config --list 
user.email=thiery.louison@redboxdigital.com
user.name=thiery louison
alias.aa=add --all
alias.bv=branch -vv

peacengell

boto3 quick hands-on

This documentation aims at being a quick-straight-to-the-point-hands-on AWS resources manipulation with [boto3][0].

First of all, you'll need to install [boto3][0]. Installing it along with [awscli][1] is probably a good idea as

• [awscli][1] is boto-based
• [awscli][1] usage is really close to boto's

peacengell

from collections import defaultdict

import boto3

"""
A tool for retrieving basic information from the running EC2 instances.
"""

# Connect to EC2
ec2 = boto3.resource('ec2')

peacengell

#!/usr/bin/env bash
# MUST BE RUN AS ROOT

usage_message(){
	echo Usage options:
	echo "1. Install proftpd: $0 -i <PASVADDR> <MIN_PORT> <MAX_PORT>"
	echo "2. Create ftp user: $0 -c <FTPUSER> <FTPPASS>"
	echo "3. Delete ftp user: $0 -d <FTPUSER>"
}

peacengell

#!/usr/bin/env bash

LOGS_FOLDER=$1
FILENAME=$2
DEST_FOLDER=/etc/logrotate.d

cat << EOF > $DEST_FOLDER/$FILENAME
$LOGS_FOLDER/*.log {
  rotate 7
  size 100M

peacengell

#!/usr/bin/env bash

# empty log file: echo "" > $(docker inspect --format='{{.LogPath}}' <container_name_or_id>)
# apply: wget -O - https://goo.gl/x86FN9 | sudo bash

FILEPATH=/etc/docker/daemon.json

cat << EOF > $FILEPATH
{
  "log-driver": "json-file",

peacengell

#!/bin/bash


SERVER_URL="$1"
KEY_WORD="$2"
SLEEP_TIME="$3"

if [ -z "$3" ]
then
    SLEEP_TIME=50