kshailen

git clone https://github.com/kshailen/httpendpointmonitoring.git
cd httpendpointmonitoring
docker-compose up -d

kshailen

# -*- mode: ruby -*-
# vi: set ft=ruby :

$script = <<-SCRIPT
wget https://apt.puppetlabs.com/puppetlabs-release-pc1-xenial.deb
dpkg -i puppetlabs-release-pc1-xenial.deb
apt-get update
SCRIPT

$server = <<-SCRIPT

kshailen

FROM python:2.7-alpine

WORKDIR /app

COPY . .

RUN pip install -r requirements.txt
ENV appname TestApp
ENV version=1.0

kshailen

import boto3
import sys
import json
from botocore.exceptions import ClientError


def delete_multipart_uploads(bucketName):
    s3 = boto3.client('s3')
    try:
        bucket_lifecycle_response = s3.get_bucket_lifecycle(Bucket=bucketName)

kshailen

import boto3
def get_multipart_upload(bucket):
    client = boto3.client('s3')
    response_multipart = client.list_multipart_uploads(Bucket=bucket)
    # print(response_multipart)
    multiparts = []
    if "Uploads" in response_multipart.keys():
        multiparts = response_multipart["Uploads"]
    return multiparts
def main():

kshailen

import boto3
def check_multipart_upload(bucket):
    client = boto3.client('s3')
    response_multipart = client.list_multipart_uploads(Bucket=bucket)
    if "Uploads" in response_multipart.keys():
        return True
    return False
def main():
    Bucket_list = ['complianx-xxdbox', 'corp-jenkins-xxxx']
    # You can change bucket list as per your usecase

kshailen

import argparse
import os

import boto3


class S3MultipartUpload(object):
  # AWS throws EntityTooSmall error for parts smaller than 5 MB
  PART_MINIMUM = int(5e6)

kshailen

#!/bin/bash
# exit when the command fails
set -o errexit;
# exit when try to use undeclared var
set -o nounset;
Total_num_of_buckets=`aws s3 ls s3:// | awk '{print $3}'| wc -l`
printf "%s: %4d\n" "Total Number of s3 buckets" ${Total_num_of_buckets} 
printf "%s: %4s\n" "Bucket Name" "Bucket Size"
region=us-east-1
#Handling for MacOS and Linux

kshailen

#!/bin/bash

# exit when the command fails
set -o errexit;
# exit when try to use undeclared var
set -o nounset;
Total_num_of_buckets=`aws s3 ls s3:// | awk '{print $NF}'| wc -l`
printf "%s: %4d\n" "Total Number of s3 buckets" ${Total_num_of_buckets} 
printf "%s: %4s\n" "Bucket Name" "Bucket Size"

kshailen

This script can help you find and remove unused AWS snapshots and volumes.

There is hardcoded list of regions that it searches, adjust the value to suit your needs.

Use snapshot.py snapshot-report to generate report.csv containing information about all snapshots.

snapshot.py snapshot-cleanup lets you interactively delete snapshot if it finds it is referencing unexisting resources.

./snapshots.py --help