Skip to content

Instantly share code, notes, and snippets.

@gabehollombe

gabehollombe/gist:3c08b0b217b80c2c6467

Last active August 29, 2015 14:09
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 1 You must be signed in to fork a gist
  • Save gabehollombe/3c08b0b217b80c2c6467 to your computer and use it in GitHub Desktop.
Save gabehollombe/3c08b0b217b80c2c6467 to your computer and use it in GitHub Desktop.
Download ZIP
Spin up an in-memory Hadoop / HDFS instance
Raw
gistfile1.txt
# Substitute path/version of hadoop files below
# Note: this will create a directory ./build/test/data/dfs/ to store your HDFS file system in. Clean this up when you're done.
HADOOP_CLASSPATH=/usr/local/Cellar/hadoop/2.4.0/libexec/share/hadoop/yarn/test/hadoop-yarn-server-tests-2.4.0-tests.jar hadoop jar /usr/local/Cellar/hadoop/2.4.0/libexec/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.4.0-tests.jar minicluster --nnport=8020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment