Skip to content

Instantly share code, notes, and snippets.

@carlcrott

carlcrott/gist:983496634aa5f615bb3e

Created December 20, 2014 22:12
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save carlcrott/983496634aa5f615bb3e to your computer and use it in GitHub Desktop.
Save carlcrott/983496634aa5f615bb3e to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
ssh ubuntu@146.148.45.20
$ sudo su -l hadoop
$ hadoop fs -mkdir input/
$ wget http://www.hamster-club.com/
$ mv index.html /tmp/setup.html
$ hadoop fs -rm input/setup.html
$ hadoop fs -copyFromLocal /tmp/setup.html input/
$ hadoop fs -ls input/
# 14/12/12 05:08:43 INFO gcs.GoogleHadoopFileSystemBase: GHFS version: 1.2.9-hadoop1
# Found 1 items
# -rwx------ 3 hadoop hadoop 9 2014-12-12 05:08 /input/setup.html
# Run the hadoop jar command to start the MapReduce job.
$ hadoop jar hadoop-examples-*.jar wordcount input output
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment