Skip to content

Instantly share code, notes, and snippets.

@tysonmote
Last active August 29, 2015 14:23
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
Star You must be signed in to star a gist
Save tysonmote/c02b0523c42ae60c27d1 to your computer and use it in GitHub Desktop.
Delete large Redis sets with Ruby and Resque
$redis = Redis.new
class SafeSetDelete
@queue = :garbage_collection
BATCH_SIZE = 100
# Rename the key and queue for deletion
def self.delete(key)
newkey = "gc:sets:#{$redis.incr("gc:index")}"
$redis.rename(key, newkey)
Resque.enqueue(self, newkey)
end
# Delete members from the set in batches
def self.perform(key)
cursor = "0"
loop do
cursor, members = $redis.sscan(key, cursor, count: BATCH_SIZE)
$redis.srem(key, members) if members.size > 0
break if cursor == "0"
end
end
end
# Example:
#
# SafeSetDelete.delete("my.large.set")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment