Skip to content

Instantly share code, notes, and snippets.

@YugalXD
Forked from robinkraft/s3bucketsize.py
Created June 6, 2017 14:26
Show Gist options
  • Save YugalXD/bd44a555b9ff53b9bb9d950fbf5c2b3b to your computer and use it in GitHub Desktop.
Save YugalXD/bd44a555b9ff53b9bb9d950fbf5c2b3b to your computer and use it in GitHub Desktop.
Simple python script to calculate size of S3 buckets
import boto
s3 = boto.connect_s3(aws_id, aws_secret_key)
# based on http://www.quora.com/Amazon-S3/What-is-the-fastest-way-to-measure-the-total-size-of-an-S3-bucket
def get_bucket_size(bucket_name):
bucket = s3.lookup(bucket_name)
total_bytes = 0
n = 0
for key in bucket:
total_bytes += key.size
n += 1
if n % 2000 == 0:
print n
total_gigs = total_bytes/1024/1024/1024
print "%s: %i GB, %i objects" % (bucket_name, total_gigs, n)
return total_gigs, n
bucket_list = []
bucket_sizes = []
for bucket_name in bucket_list:
size, object_count = get_bucket_size(bucket_name)
bucket_sizes.append(dict(name=bucket_name, size=size, count=object_count))
print "\nTotals:"
for bucket_size in bucket_sizes:
print "%s: %iGB, %i objects" % (bucket_size["name"], bucket_size["size"], bucket_size["count"])
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment