#!/usr/bin/env ruby | |
# List all keys stored in memcache. | |
# Credit to Graham King at http://www.darkcoding.net/software/memcached-list-all-keys/ for the original article on how to get the data from memcache in the first place. | |
require 'net/telnet' | |
headings = %w(id expires bytes cache_key) | |
rows = [] | |
localhost = Net::Telnet::new("Host" => "localhost", "Port" => 11211, "Timeout" => 3) | |
matches = localhost.cmd("String" => "stats items", "Match" => /^END/).scan(/STAT items:(\d+):number (\d+)/) | |
slabs = matches.inject([]) { |items, item| items << Hash[*['id','items'].zip(item).flatten]; items } | |
longest_key_len = 0 | |
slabs.each do |slab| | |
localhost.cmd("String" => "stats cachedump #{slab['id']} #{slab['items']}", "Match" => /^END/) do |c| | |
matches = c.scan(/^ITEM (.+?) \[(\d+) b; (\d+) s\]$/).each do |key_data| | |
cache_key, bytes, expires_time = key_data | |
rows << [slab['id'], Time.at(expires_time.to_i), bytes, cache_key] | |
longest_key_len = [longest_key_len,cache_key.length].max | |
end | |
end | |
end | |
row_format = %Q(|%8s | %28s | %12s | %-#{longest_key_len}s |) | |
puts row_format%headings | |
rows.each{|row| puts row_format%row} | |
localhost.close |
This comment has been minimized.
This comment has been minimized.
+1 extremely helpful for debugging. thank you. |
This comment has been minimized.
This comment has been minimized.
No problem guys! It's super silly that there is no easy way to do this out of the box. I try to use Redis as much as I can but sometimes memcached is the right tool :) Also because it wasn't mentioned anywhere, Graham King, whose article at http://www.darkcoding.net/software/memcached-list-all-keys/ helped out here. |
This comment has been minimized.
This comment has been minimized.
very useful !! |
This comment has been minimized.
This comment has been minimized.
very useful! thank you :D |
This comment has been minimized.
This comment has been minimized.
Thanks for the code! Used it for a simple command line tool to list and get the value for specific keys. https://gist.github.com/3168935 |
This comment has been minimized.
This comment has been minimized.
Thank you! |
This comment has been minimized.
This comment has been minimized.
The telnet lib for me was (inconsistently) calling the code block several times, updating the block as follows did the trick for me.
|
This comment has been minimized.
This comment has been minimized.
Very useful little snippet, but I wanted the output to be a little more verbose, as well as retrieve the exact amount of items in a slab. I added the #!/usr/bin/env ruby
require 'net/telnet'
require 'terminal-table'
tbl = Terminal::Table.new headings: %w(id expires cache_key bytes)
localhost = Net::Telnet::new("Host" => "localhost", "Port" => 11211, "Timeout" => 3)
matches = localhost.cmd("String" => "stats items", "Match" => /^END/).scan(/STAT items:(\d+):number (\d+)/)
slabs = matches.inject([]) { |items, item| items << Hash[*['id','items'].zip(item).flatten]; items }
slabs.each do |slab|
localhost.cmd("String" => "stats cachedump #{slab['id']} #{slab['items']}", "Match" => /^END/) do |c|
matches = c.scan(/^ITEM (.+?) \[(\d+) b; (\d+) s\]$/).each do |key_data|
cache_key, bytes, expires_time = key_data
tbl << [slab['id'], Time.at(expires_time.to_i), cache_key, bytes]
end
end
end
puts tbl
localhost.close |
This comment has been minimized.
This comment has been minimized.
Nice script! Very useful indeed. Thanks |
This comment has been minimized.
This comment has been minimized.
Thanks for the updates to this old gist of mine. It's amazing how well social coding works sometimes, and how this started from a blurb from Graham King's website! @kryptek : I like what you've done, sans the gem dependency. I see this guy as a quick and dirty thing you want to throw on a system to figure out what the heck is going on with cache, and it's a distraction to install a gem. I updated the gist with your revision and with baked-in formatting instead :) If the code block is still getting called multiple times with the new version, please let me know and I'll dig in to it further |
This comment has been minimized.
This comment has been minimized.
@bkimble Thanks for the script! I've added some very simple and inefficient content grabbing to it. For my purposes I only want to see the content when it's ASCII encoded, but I've commented that line out. # List all keys stored in memcache.
# Credit to Graham King at http://www.darkcoding.net/software/memcached-list-all-keys/ for the original article on how to get the data from memcache in the first place.
require 'net/telnet'
headings = %w(id expires bytes cache_key content)
rows = []
localhost = Net::Telnet::new("Host" => "localhost", "Port" => 11211, "Timeout" => 3)
matches = localhost.cmd("String" => "stats items", "Match" => /^END/).scan(/STAT items:(\d+):number (\d+)/)
slabs = matches.inject([]) { |items, item| items << Hash[*['id','items'].zip(item).flatten]; items }
longest_key_len = 0
longest_content_len = 0
slabs.each do |slab|
localhost.cmd("String" => "stats cachedump #{slab['id']} #{slab['items']}", "Match" => /^END/) do |c|
matches = c.scan(/^ITEM (.+?) \[(\d+) b; (\d+) s\]$/).each do |key_data|
cache_key, bytes, expires_time = key_data
content = localhost.cmd("String" => "get #{cache_key}", "Match" => /^END/) {|c| c}
#content = content.ascii_only? ? content : "Not ASCII, whatever it is" #make it a little more pipeline friendly
rows << [slab['id'], Time.at(expires_time.to_i), bytes, cache_key, content]
longest_content_len = [longest_content_len, content.length].max
longest_key_len = [longest_key_len,cache_key.length].max
end
end
end
row_format = %Q(|%8s | %28s | %12s | %-#{longest_key_len}s | %-#{longest_content_len}s |)
puts row_format%headings
rows.each{|row| puts row_format%row}
localhost.close |
This comment has been minimized.
This comment has been minimized.
Thanks! |
This comment has been minimized.
This comment has been minimized.
Someone had to do this in a remote server, like Memcachier? |
This comment has been minimized.
This comment has been minimized.
Any help on doing this in a remote server would be great! |
This comment has been minimized.
This comment has been minimized.
To do this on a remote server, you'd have a few options. Either deploy this script to your memcache servers and run it there, or just change localhost = Net::Telnet::new("Host" => "localhost", "Port" => 11211, "Timeout" => 3) to be the actual host/port of your memcache server. Keep in mind that firewall rules on your server could limit access to memcache in this manner and you may wind up having to put the script on the server anyway. |
This comment has been minimized.
This comment has been minimized.
does it list all the keys or most of them? |
This comment has been minimized.
This comment has been minimized.
As I didn't know about this snippet I created a similar one based on the same source. Please have a look if you find it useful.
|
This comment has been minimized.
This comment has been minimized.
@gfa from the first couple of lines of the source in |
This comment has been minimized.
This comment has been minimized.
@bkimble thanks for this! Here's yet another fork of your original gist: This revision adds a couple of features for working with cache item rows as ruby objects.
I've included a method that mimics your original formatted printing, plus a method that returns all found cache items as an array of hashes. |
This comment has been minimized.
This comment has been minimized.
Unfortunately it does not work when the server has several 100 thousand keys... |
This comment has been minimized.
This comment has been minimized.
excellent, thanks a lot! |
This comment has been minimized.
This comment has been minimized.
Nice |
This comment has been minimized.
This comment has been minimized.
I'm fairly certain this does not work on memcachier. I successfully telneted in to our production servers and tried issues the stats cachedump command and got: CLIENT_ERROR unsupported stats command |
This comment has been minimized.
This comment has been minimized.
bingo! |
This comment has been minimized.
This comment has been minimized.
Thank you! This help me to solve problem of infinite caching(no expiration). |
This comment has been minimized.
This comment has been minimized.
Hello, @bkimble. I have adjusted your Gist a bit, see: https://gist.github.com/archan937/f441146e1aeaa9da138e337514ee4000 The logic is in a method called |
This comment has been minimized.
Great, very useful - thanks!