Skip to content

Instantly share code, notes, and snippets.

@gaborgsomogyi
Last active July 4, 2018 12:06
Show Gist options
  • Save gaborgsomogyi/8dddd3344f39eadb37a2840f1ed39e9f to your computer and use it in GitHub Desktop.
Save gaborgsomogyi/8dddd3344f39eadb37a2840f1ed39e9f to your computer and use it in GitHub Desktop.
import java.util.Map;
import scala.Tuple2;
import java.util.Iterator;
Map<String, String> env = System.getenv();
for (String envName : env.keySet()) {
System.out.format("ENV: %s=%s%n", envName, env.get(envName));
}
for (String s: args) {
System.out.println("ARGS: " + s);
}
for (Tuple2<String, String> t: sparkConf.getAll()) {
System.out.println("SPARKCONF: " + t._1 + "=" + t._2);
}
Iterator<Map.Entry<String, String>> it = spark.hadoopConfiguration().iterator();
while (it.hasNext()) {
System.out.println("HADOOPCONF: " + it.next());
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment