Skip to content

Instantly share code, notes, and snippets.

@anish749 anish749/

Last active Aug 4, 2019
What would you like to do?
Quickly switch to Java 8

Weird errros with Apache Spark / Beam / Scio?

For most of 2019 and early 2020, this will most likely be caused by not having the right Java version.

As of August 2019, all big data frame works mostly are written and compatible with Java 8.

Check your java version here:

$ java -version

If this outputs:

java version ""
Java(TM) SE Runtime Environment (build
Java HotSpot(TM) 64-Bit Server VM (build xxx, mixed mode)

You are all set, otherwise:

Download Java 8 from here and then install it.

Next export java home (on a Mac) as follows:

$ export JAVA_HOME=$(/usr/libexec/java_home -v 1.8)

You might also want to add the above line to your .bash_profile so that your default java version is Java 8, and you don't have to change it everytime.

$ echo 'export JAVA_HOME=$(/usr/libexec/java_home -v 1.8)' >> ~/.bash_profile
$ source ~/.bash_profile

If you are an advanced user or you want to switch versions frequently, you might want to use jenv

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.