johnmuller87/setup.sh

Created January 29, 2018 10:23

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/johnmuller87/ead0b6d1f2da1120d992ff4de124c413.js"></script>
Save johnmuller87/ead0b6d1f2da1120d992ff4de124c413 to your computer and use it in GitHub Desktop.

Download ZIP

Create your jar and pass it to PySpark

Raw

	# create the jar using SBT
	sbt clean assembly

	# Pass the jar to the PySpark session
	pyspark --jars [path/to/jar/x.jar]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment