Skip to content

Instantly share code, notes, and snippets.

@ralph-tice
Created June 11, 2013 18:05
Show Gist options
  • Save ralph-tice/5759242 to your computer and use it in GitHub Desktop.
Save ralph-tice/5759242 to your computer and use it in GitHub Desktop.
hadoop OSX bootstrap
wget http://apache.claz.org/hadoop/common/hadoop-1.2.0/hadoop-1.2.0-bin.tar.gz
gzip -d hadoop-1.2.0-bin.tar.gz
tar xvf hadoop-1.2.0-bin.tar
cd hadoop-1.2.0
mkdir input
cp ../conf/*.xml ./
export JAVA_HOME=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
export HADOOP_HOME=/Users/ralphtice/hadoop/hadoop-1.2.0/
export HADOOP_OPTS="-Djava.security.krb5.realm=OX.AC.UK -Djava.security.krb5.kdc=kdc0.ox.ac.uk:kdc1.ox.ac.uk"
bin/hadoop jar hadoop-examples-*.jar grep input output 'dfs[a-z.]+'
#the below might be just for hive setup ...
$HADOOP_HOME/bin/hadoop fs -mkdir /tmp
$HADOOP_HOME/bin/hadoop fs -chmod g+w /tmp
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment