Skip to content

Instantly share code, notes, and snippets.

@softberries

softberries/README.md

Created October 23, 2017 12:18
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save softberries/292098e2da7a6068de1e95b88b2b3759 to your computer and use it in GitHub Desktop.
Save softberries/292098e2da7a6068de1e95b88b2b3759 to your computer and use it in GitHub Desktop.
Download ZIP
start up emr cluster with the task attached
Raw
README.md

aws emr create-cluster --name "Scalding test cluster" --ami-version 3.9.0 --use-default-roles --instance-type m1.medium --instance-count 3 --log-uri s3://grajo001out/2 --steps Type=CUSTOM_JAR,Name="EMR Tutorial",ActionOnFailure=TERMINATE_CLUSTER,Jar=s3://grajo001log/emr-scalding-tutorial-assembly-0.1.jar ,Args=["com.softwaremill.AgeCounterJob","--hdfs","--input","s3n://grajo001log/users/*","--output","s3n://grajo001log/output"] --auto-terminate

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment