Skip to content

Instantly share code, notes, and snippets.

@vlcinsky
Created September 18, 2011 21:13
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save vlcinsky/1225558 to your computer and use it in GitHub Desktop.
Save vlcinsky/1225558 to your computer and use it in GitHub Desktop.
Modified boto to overcome shortened listing of object versions in AWS S3 problem
def versioned_bucket_lister(bucket, prefix='', delimiter='',
key_marker='', version_id_marker='', headers=None):
"""
A generator function for listing versions in a bucket.
"""
more_results = True
k = None
while more_results:
rs = bucket.get_all_versions(prefix=prefix, key_marker=key_marker,
version_id_marker=version_id_marker,
delimiter=delimiter, headers=headers,
max_keys = 999) #max_keys parameter added
for k in rs:
yield k
key_marker = rs.next_key_marker
version_id_marker = rs.next_version_id_marker
more_results= rs.is_truncated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment