Skip to content

Instantly share code, notes, and snippets.

@yuwtennis
Created February 13, 2022 10:44
Show Gist options
  • Save yuwtennis/26aef3e1d34dd672861a4da0362f8949 to your computer and use it in GitHub Desktop.
Save yuwtennis/26aef3e1d34dd672861a4da0362f8949 to your computer and use it in GitHub Desktop.
[ywatanabe@laptop-archlinux spark3.2.1]$ bin/spark-shell
22/02/13 17:06:55 WARN Utils: Your hostname, laptop-archlinux resolves to a loopback address: 127.0.0.1; using 10.23.109.137 instead (on interface wlp0s20f3)
22/02/13 17:06:55 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/opt/spark3.2.1/jars/spark-unsafe_2.12-3.2.1.jar) to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
22/02/13 17:06:59 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
22/02/13 17:07:00 WARN Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041.
Spark context Web UI available at http://10.23.109.137:4041
Spark context available as 'sc' (master = local[*], app id = local-1644739620179).
Spark session available as 'spark'.
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 3.2.1
/_/
Using Scala version 2.12.15 (OpenJDK 64-Bit Server VM, Java 11.0.13)
Type in expressions to have them evaluated.
Type :help for more information.
[ywatanabe@laptop-archlinux spark3.1.2]$ bin/spark-shell
22/02/13 16:53:47 WARN Utils: Your hostname, laptop-archlinux resolves to a loopback address: 127.0.0.1; using 10.23.109.137 instead (on interface wlp0s20f3)
22/02/13 16:53:47 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/opt/spark3.1.2/jars/spark-unsafe_2.12-3.1.2.jar) to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
22/02/13 16:53:47 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
Spark context Web UI available at http://10.23.109.137:4040
Spark context available as 'sc' (master = local[*], app id = local-1644738831459).
Spark session available as 'spark'.
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 3.1.2
/_/
Using Scala version 2.12.10 (OpenJDK 64-Bit Server VM, Java 11.0.13)
Type in expressions to have them evaluated.
Type :help for more information.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment