Skip to content

Instantly share code, notes, and snippets.

@jordangraft
Created February 8, 2017 10:33
Show Gist options
  • Save jordangraft/038ddc288e1b1cb6e14bbf17d0aeece1 to your computer and use it in GitHub Desktop.
Save jordangraft/038ddc288e1b1cb6e14bbf17d0aeece1 to your computer and use it in GitHub Desktop.
S3 Massive Data Transfer Hadoop Job
$ wget http://ufpr.dl.sourceforge.net/project/s3tools/s3cmd/1.6.1/s3cmd-1.6.1.tar.gz
$ tar xzf s3cmd-1.6.1.tar.gz
$ cd s3cmd-1.6.1
$ sudo python setup.py install
$ ./s3cmd --configure
# Add in your Access and secret keys
# Enter through the remaining prompts
# Save configuration
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment