Skip to content

Instantly share code, notes, and snippets.

@epicserve
Last active February 21, 2024 18:30
Show Gist options
  • Save epicserve/5699837 to your computer and use it in GitHub Desktop.
Save epicserve/5699837 to your computer and use it in GitHub Desktop.
A simple script to print the size of all your Redis keys.
#!/usr/bin/env bash
# This script prints out all of your Redis keys and their size in a human readable format
# Copyright 2013 Brent O'Connor
# License: http://www.apache.org/licenses/LICENSE-2.0
human_size() {
awk -v sum="$1" ' BEGIN {hum[1024^3]="Gb"; hum[1024^2]="Mb"; hum[1024]="Kb"; for (x=1024^3; x>=1024; x/=1024) { if (sum>=x) { printf "%.2f %s\n",sum/x,hum[x]; break; } } if (sum<1024) print "1kb"; } '
}
redis_cmd='redis-cli'
# get keys and sizes
for k in `$redis_cmd keys "*"`; do key_size_bytes=`$redis_cmd debug object $k | perl -wpe 's/^.+serializedlength:([\d]+).+$/$1/g'`; size_key_list="$size_key_list$key_size_bytes $k\n"; done
# sort the list
sorted_key_list=`echo -e "$size_key_list" | sort -n`
# print out the list with human readable sizes
echo -e "$sorted_key_list" | while read l; do
if [[ -n "$l" ]]; then
size=`echo $l | perl -wpe 's/^(\d+).+/$1/g'`; hsize=`human_size "$size"`; key=`echo $l | perl -wpe 's/^\d+(.+)/$1/g'`; printf "%-10s%s\n" "$hsize" "$key";
fi
done
@aalfson
Copy link

aalfson commented Aug 19, 2014

Awesome work!

@merkerxu
Copy link

Thanks. It's very helpful!

@mistidoi
Copy link

mistidoi commented Dec 1, 2014

This saved me some real time today. Thanks for your good work!

@ghariharan
Copy link

But will the 'serializedlength' include the index size(and all other relavant stuffs) redis maintains for that key?? I need the entire memory size consumed by redis for a single key..

@davidwebber
Copy link

Nice! Thank you.

@moses-gangipogu
Copy link

0.00 Gb ERR unknown command 'debug'

redis-cli -h amazonaws.redis.hostname DEBUG OBJECT
(error) ERR unknown command 'DEBUG'

any idea on this error ?

@snicky
Copy link

snicky commented Sep 22, 2015

If you use an external Redis hosting you might have the DEBUG command disabled. For example, this is a list of disabled commands on one of popular Redis providers: CONFIG, SHUTDOWN, BGREWRITEAOF, BGSAVE, SAVE, DEBUG, and KEYS

@emacsist
Copy link

It's too slow for large keys....

@sakovias
Copy link

sakovias commented Mar 9, 2016

Nice work! So there's no way to profile on AWS ElasticCache since DEBUG is disabled?

@pboling
Copy link

pboling commented Jul 14, 2016

@sakovias - Seems correct. http://docs.aws.amazon.com/AmazonElastiCache/latest/UserGuide/ClientConfig.RestrictedCommands.html

Only option for AWS ElastiCache is to use a tool that does not rely on debug, perhaps: https://github.com/antirez/redis-sampler

@nehcuoh
Copy link

nehcuoh commented Oct 9, 2016

This work for me. Awesome and niubible!!!

@creativeHats
Copy link

How to use with authentication?

@slenart
Copy link

slenart commented Nov 2, 2017

guys, you have info command with total memory usage. iterating all keys with ineffective keys * is not a good approach.

@rndbblnn
Copy link

rndbblnn commented Jan 9, 2018

FYI: the script doesn't work if you're using Redis on AWS Elasticache, 'redis-cli debug' command not supported.

@guoruibiao
Copy link

guys, you have info command with total memory usage. iterating all keys with ineffective keys * is not a good approach.

that's really a bad idea by using this script on product environment. Maybe using scan command to get the keys by application, and then apply this script can get a better efficientily.

@andrewbrg
Copy link

guys, you have info command with total memory usage. iterating all keys with ineffective keys * is not a good approach.

that's really a bad idea by using this script on product environment. Maybe using scan command to get the keys by application, and then apply this script can get a better efficientily.

Agree

@navi2589
Copy link

navi2589 commented Dec 4, 2019

what does that -e does in echo?

@epicserve
Copy link
Author

@navi2589, Try running the following and see what it does.

echo -e "Blah\nFoo\n\nBar"

@sg552
Copy link

sg552 commented Jan 14, 2020

it doesn't work on ubuntu 18.

Just calculate the size by your brain, the serializedsize unit is 'byte', so 1024 = 1k, 1024000 = 1MB

@16g
Copy link

16g commented Nov 15, 2022

Nice!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment