Skip to content

Instantly share code, notes, and snippets.

@guyrt
Created March 29, 2013 01:37
Show Gist options
  • Save guyrt/5268176 to your computer and use it in GitHub Desktop.
Save guyrt/5268176 to your computer and use it in GitHub Desktop.
Installer for sqoop on Amazon's EMR
#!/bin/bash
# Install sqoop and mysql connector. Store in s3 and load
# as bootstrap step.
bucket_location='<put your bucket here>'
sqoop_jar='sqoop-1.4.3.bin__hadoop-1.0.0'
sqoop_jar_gz=$sqoop_jar.tar.gz
mysql_dir='mysql-connector-java-5.1.24'
mysql_jar='mysql-connector-java-5.1.24-bin.jar'
mysql_dir_gz=$mysql_dir.tar.gz
cd
hadoop fs -copyToLocal $bucket_location$sqoop_jar_gz .
tar -xzf $sqoop_jar_gz
hadoop fs -copyToLocal $bucket_location$mysql_dir_gz .
tar -xzf $mysql_dir_gz
cp $mysql_dir/$mysql_jar $sqoop_jar/lib
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment