Skip to content

Instantly share code, notes, and snippets.

@jeff303

jeff303/print-spark-version.sh

Created August 29, 2019 20:12
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jeff303/c28421b864c19d2d6b775deffee3a0bf to your computer and use it in GitHub Desktop.
Save jeff303/c28421b864c19d2d6b775deffee3a0bf to your computer and use it in GitHub Desktop.
Download ZIP
Print installed Apache Spark version to stdout
Raw
print-spark-version.sh
#/bin/bash
echo 'System.out.println(sc.version)' | spark-shell 2>/dev/null | grep -A2 'System.out.println' | grep -v 'System.out.println'
@jeff303
Copy link
Author

jeff303 commented Aug 29, 2019

Relies on spark-shell being on PATH.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment