Mark Kusper ns-mkusper

## Documentation.md

      
              2 files
            
          
              170 forks
            
          
              81 comments
            
          
              958 stars
            
          
                KartikTalwar
                / Documentation.md
            
            
              Last active
              May 9, 2024 12:59
            
              
                Rsync over SSH - (40MB/s over 1GB NICs)
              
          
    The fastest remote directory rsync over ssh archival I can muster (40MB/s over 1gb NICs)

This creates an archive that does the following:

rsync
(Everyone seems to like -z, but it is much slower for me)

a: archive mode - rescursive, preserves owner, preserves permissions, preserves modification times, preserves group, copies symlinks as symlinks, preserves device files.
H: preserves hard-links
A: preserves ACLs


## s3bucketsize.py
import sys

import boto


# based on http://www.quora.com/Amazon-S3/What-is-the-fastest-way-to-measure-the-total-size-of-an-S3-bucket

# assumes you've already configured your access id & secret key
s3 = boto.connect_s3()
	import sys

	import boto


	# based on http://www.quora.com/Amazon-S3/What-is-the-fastest-way-to-measure-the-total-size-of-an-S3-bucket

	# assumes you've already configured your access id & secret key
	s3 = boto.connect_s3()