Skip to content

Instantly share code, notes, and snippets.

@andypern
Last active August 29, 2015 14:01
Show Gist options
  • Save andypern/ef520c2ed80c76a961c3 to your computer and use it in GitHub Desktop.
Save andypern/ef520c2ed80c76a961c3 to your computer and use it in GitHub Desktop.
#!/usr/bin/bash
export SHARK_HOME=/opt/mapr/shark/shark-0.9.0
export SPARK_HOME=/opt/mapr/spark/spark-0.9.1
export SCALA_HOME=/usr/share/java
export CLASSPATH
###Jars for our app###
#first, use the JAR we care about
CLASSPATH+=target/scala-2.10/0mqtest_2.10-1.0.jar
#next, grab jars from mapR spark + shark folders
for jar in `find $SPARK_HOME -name '*.jar'`; do
CLASSPATH+=:$jar
done
for jar in `find $SHARK_HOME/lib_managed -name '*.jar'`; do
CLASSPATH+=:$jar
done
####MapR stuff
for jar in `find /opt/mapr/hadoop -name '*.jar'`;do
CLASSPATH+=:$jar
done
for jar in `find /opt/mapr/hbase -name '*.jar'`;do
CLASSPATH+=:$jar
done
####end MapR stuff
#lastly, grab JARS from scala dir
for jar in `find $SCALA_HOME -name 'scala*.jar'`; do
CLASSPATH+=:$jar
done
# Add in the mapR FS jar
CLASSPATH+=:/opt/mapr/lib/maprfs-1.0.3-mapr-3.0.3.jar
#finally, execute the code
/usr/bin/java -cp $CLASSPATH org.apache.spark.streaming.examples.SimpleZeroMQPublisher tcp://localhost:1234 foo
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment