Skip to content

Instantly share code, notes, and snippets.

@jeongho
Created February 4, 2016 18:03
Show Gist options
  • Save jeongho/371aaed47ab462d79851 to your computer and use it in GitHub Desktop.
Save jeongho/371aaed47ab462d79851 to your computer and use it in GitHub Desktop.
Hadoop benchmark 1. run pi job
#!/bin/bash
# mapreduce pi calculation to validate hadoop cluster setup
#
# command to run nohub
# nohup bash ./run_pi_job.sh > pi_job.out 2>&1 &
# sudo -u hdfs nohup bash /tmp/run_pi_job.sh > /tmp/pi_job.out 2>&1 &
#parcel
hadoop_jar=/opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce/hadoop-examples.jar
hadoop jar $hadoop_jar pi 10 100
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment