Created
January 3, 2017 04:35
-
-
Save 1ambda/5caf92753ea2f95ada11b1c13945d261 to your computer and use it in GitHub Desktop.
pyspark cassandra log
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 1.6.2-bin-hadoop2.6 ./bin/pyspark --packages com.datastax.spark:spark-cassandra-connector_2.10:1.6.2,TargetHolding:pyspark-cassandra:0.3.5 --exclude-packages org.slf4j:slf4j-api | |
| Python 2.7.12 (default, Dec 16 2016, 13:04:21) | |
| [GCC 4.2.1 Compatible Apple LLVM 8.0.0 (clang-800.0.42.1)] on darwin | |
| Type "help", "copyright", "credits" or "license" for more information. | |
| Ivy Default Cache set to: /Users/lambda/.ivy2/cache | |
| The jars for the packages stored in: /Users/lambda/.ivy2/jars | |
| :: loading settings :: url = jar:file:/Users/lambda/github/apache-spark/1.6.2-bin-hadoop2.6/lib/spark-assembly-1.6.2-hadoop2.6.0.jar!/org/apache/ivy/core/settings/ivysettings.xml | |
| com.datastax.spark#spark-cassandra-connector_2.10 added as a dependency | |
| TargetHolding#pyspark-cassandra added as a dependency | |
| :: resolving dependencies :: org.apache.spark#spark-submit-parent;1.0 | |
| confs: [default] | |
| found com.datastax.spark#spark-cassandra-connector_2.10;1.6.2 in central | |
| found joda-time#joda-time;2.3 in local-m2-cache | |
| found com.twitter#jsr166e;1.1.0 in local-m2-cache | |
| found io.netty#netty-all;4.0.33.Final in central | |
| found org.joda#joda-convert;1.2 in local-m2-cache | |
| found org.scala-lang#scala-reflect;2.10.5 in local-m2-cache | |
| found TargetHolding#pyspark-cassandra;0.3.5 in spark-packages | |
| found com.datastax.spark#spark-cassandra-connector-java_2.10;1.6.0-M1 in central | |
| found org.apache.cassandra#cassandra-clientutil;3.0.2 in central | |
| found com.datastax.cassandra#cassandra-driver-core;3.0.0 in central | |
| found io.netty#netty-handler;4.0.33.Final in local-m2-cache | |
| found io.netty#netty-buffer;4.0.33.Final in local-m2-cache | |
| found io.netty#netty-common;4.0.33.Final in local-m2-cache | |
| found io.netty#netty-transport;4.0.33.Final in local-m2-cache | |
| found io.netty#netty-codec;4.0.33.Final in local-m2-cache | |
| found io.dropwizard.metrics#metrics-core;3.1.2 in local-m2-cache | |
| found org.apache.commons#commons-lang3;3.3.2 in local-m2-cache | |
| found com.google.guava#guava;16.0.1 in local-m2-cache | |
| downloading https://repo1.maven.org/maven2/com/datastax/spark/spark-cassandra-connector_2.10/1.6.2/spark-cassandra-connector_2.10-1.6.2.jar ... | |
| [SUCCESSFUL ] com.datastax.spark#spark-cassandra-connector_2.10;1.6.2!spark-cassandra-connector_2.10.jar (450ms) | |
| downloading http://dl.bintray.com/spark-packages/maven/TargetHolding/pyspark-cassandra/0.3.5/pyspark-cassandra-0.3.5.jar ... | |
| [SUCCESSFUL ] TargetHolding#pyspark-cassandra;0.3.5!pyspark-cassandra.jar (310ms) | |
| downloading https://repo1.maven.org/maven2/com/datastax/spark/spark-cassandra-connector-java_2.10/1.6.0-M1/spark-cassandra-connector-java_2.10-1.6.0-M1.jar ... | |
| [SUCCESSFUL ] com.datastax.spark#spark-cassandra-connector-java_2.10;1.6.0-M1!spark-cassandra-connector-java_2.10.jar (23ms) | |
| downloading https://repo1.maven.org/maven2/com/datastax/cassandra/cassandra-driver-core/3.0.0/cassandra-driver-core-3.0.0.jar ... | |
| [SUCCESSFUL ] com.datastax.cassandra#cassandra-driver-core;3.0.0!cassandra-driver-core.jar(bundle) (78ms) | |
| :: resolution report :: resolve 2819ms :: artifacts dl 870ms | |
| :: modules in use: | |
| TargetHolding#pyspark-cassandra;0.3.5 from spark-packages in [default] | |
| com.datastax.cassandra#cassandra-driver-core;3.0.0 from central in [default] | |
| com.datastax.spark#spark-cassandra-connector-java_2.10;1.6.0-M1 from central in [default] | |
| com.datastax.spark#spark-cassandra-connector_2.10;1.6.2 from central in [default] | |
| com.google.guava#guava;16.0.1 from local-m2-cache in [default] | |
| com.twitter#jsr166e;1.1.0 from local-m2-cache in [default] | |
| io.dropwizard.metrics#metrics-core;3.1.2 from local-m2-cache in [default] | |
| io.netty#netty-all;4.0.33.Final from central in [default] | |
| io.netty#netty-buffer;4.0.33.Final from local-m2-cache in [default] | |
| io.netty#netty-codec;4.0.33.Final from local-m2-cache in [default] | |
| io.netty#netty-common;4.0.33.Final from local-m2-cache in [default] | |
| io.netty#netty-handler;4.0.33.Final from local-m2-cache in [default] | |
| io.netty#netty-transport;4.0.33.Final from local-m2-cache in [default] | |
| joda-time#joda-time;2.3 from local-m2-cache in [default] | |
| org.apache.cassandra#cassandra-clientutil;3.0.2 from central in [default] | |
| org.apache.commons#commons-lang3;3.3.2 from local-m2-cache in [default] | |
| org.joda#joda-convert;1.2 from local-m2-cache in [default] | |
| org.scala-lang#scala-reflect;2.10.5 from local-m2-cache in [default] | |
| :: evicted modules: | |
| com.datastax.spark#spark-cassandra-connector_2.10;1.6.0-M1 by [com.datastax.spark#spark-cassandra-connector_2.10;1.6.2] in [default] | |
| --------------------------------------------------------------------- | |
| | | modules || artifacts | | |
| | conf | number| search|dwnlded|evicted|| number|dwnlded| | |
| --------------------------------------------------------------------- | |
| | default | 19 | 11 | 11 | 1 || 18 | 4 | | |
| --------------------------------------------------------------------- | |
| :: problems summary :: | |
| :::: ERRORS | |
| unknown resolver null | |
| unknown resolver null | |
| unknown resolver null | |
| :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS | |
| :: retrieving :: org.apache.spark#spark-submit-parent | |
| confs: [default] | |
| 0 artifacts copied, 18 already retrieved (0kB/6ms) | |
| Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties | |
| 17/01/03 13:34:34 INFO SparkContext: Running Spark version 1.6.2 | |
| 17/01/03 13:34:34 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable | |
| 17/01/03 13:34:34 INFO SecurityManager: Changing view acls to: lambda | |
| 17/01/03 13:34:34 INFO SecurityManager: Changing modify acls to: lambda | |
| 17/01/03 13:34:34 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(lambda); users with modify permissions: Set(lambda) | |
| 17/01/03 13:34:34 INFO Utils: Successfully started service 'sparkDriver' on port 51550. | |
| 17/01/03 13:34:34 INFO Slf4jLogger: Slf4jLogger started | |
| 17/01/03 13:34:35 INFO Remoting: Starting remoting | |
| 17/01/03 13:34:35 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriverActorSystem@10.0.0.26:51551] | |
| 17/01/03 13:34:35 INFO Utils: Successfully started service 'sparkDriverActorSystem' on port 51551. | |
| 17/01/03 13:34:35 INFO SparkEnv: Registering MapOutputTracker | |
| 17/01/03 13:34:35 INFO SparkEnv: Registering BlockManagerMaster | |
| 17/01/03 13:34:35 INFO DiskBlockManager: Created local directory at /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/blockmgr-228820da-57cb-4ebf-aa04-4cfe65eb418f | |
| 17/01/03 13:34:35 INFO MemoryStore: MemoryStore started with capacity 511.1 MB | |
| 17/01/03 13:34:35 INFO SparkEnv: Registering OutputCommitCoordinator | |
| 17/01/03 13:34:35 INFO Utils: Successfully started service 'SparkUI' on port 4040. | |
| 17/01/03 13:34:35 INFO SparkUI: Started SparkUI at http://10.0.0.26:4040 | |
| 17/01/03 13:34:35 INFO HttpFileServer: HTTP File server directory is /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/httpd-e4ba25c5-b3ea-4bf8-8b14-64406d47799a | |
| 17/01/03 13:34:35 INFO HttpServer: Starting HTTP Server | |
| 17/01/03 13:34:35 INFO Utils: Successfully started service 'HTTP file server' on port 51552. | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/com.datastax.spark_spark-cassandra-connector_2.10-1.6.2.jar at http://10.0.0.26:51552/jars/com.datastax.spark_spark-cassandra-connector_2.10-1.6.2.jar with timestamp 1483418075367 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/TargetHolding_pyspark-cassandra-0.3.5.jar at http://10.0.0.26:51552/jars/TargetHolding_pyspark-cassandra-0.3.5.jar with timestamp 1483418075368 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/joda-time_joda-time-2.3.jar at http://10.0.0.26:51552/jars/joda-time_joda-time-2.3.jar with timestamp 1483418075370 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/com.twitter_jsr166e-1.1.0.jar at http://10.0.0.26:51552/jars/com.twitter_jsr166e-1.1.0.jar with timestamp 1483418075370 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/io.netty_netty-all-4.0.33.Final.jar at http://10.0.0.26:51552/jars/io.netty_netty-all-4.0.33.Final.jar with timestamp 1483418075373 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/org.joda_joda-convert-1.2.jar at http://10.0.0.26:51552/jars/org.joda_joda-convert-1.2.jar with timestamp 1483418075374 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/org.scala-lang_scala-reflect-2.10.5.jar at http://10.0.0.26:51552/jars/org.scala-lang_scala-reflect-2.10.5.jar with timestamp 1483418075381 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/com.datastax.spark_spark-cassandra-connector-java_2.10-1.6.0-M1.jar at http://10.0.0.26:51552/jars/com.datastax.spark_spark-cassandra-connector-java_2.10-1.6.0-M1.jar with timestamp 1483418075381 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/org.apache.cassandra_cassandra-clientutil-3.0.2.jar at http://10.0.0.26:51552/jars/org.apache.cassandra_cassandra-clientutil-3.0.2.jar with timestamp 1483418075382 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/com.datastax.cassandra_cassandra-driver-core-3.0.0.jar at http://10.0.0.26:51552/jars/com.datastax.cassandra_cassandra-driver-core-3.0.0.jar with timestamp 1483418075384 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/org.apache.commons_commons-lang3-3.3.2.jar at http://10.0.0.26:51552/jars/org.apache.commons_commons-lang3-3.3.2.jar with timestamp 1483418075385 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/com.google.guava_guava-16.0.1.jar at http://10.0.0.26:51552/jars/com.google.guava_guava-16.0.1.jar with timestamp 1483418075388 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/io.netty_netty-handler-4.0.33.Final.jar at http://10.0.0.26:51552/jars/io.netty_netty-handler-4.0.33.Final.jar with timestamp 1483418075389 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/io.dropwizard.metrics_metrics-core-3.1.2.jar at http://10.0.0.26:51552/jars/io.dropwizard.metrics_metrics-core-3.1.2.jar with timestamp 1483418075390 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/io.netty_netty-buffer-4.0.33.Final.jar at http://10.0.0.26:51552/jars/io.netty_netty-buffer-4.0.33.Final.jar with timestamp 1483418075391 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/io.netty_netty-transport-4.0.33.Final.jar at http://10.0.0.26:51552/jars/io.netty_netty-transport-4.0.33.Final.jar with timestamp 1483418075392 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/io.netty_netty-codec-4.0.33.Final.jar at http://10.0.0.26:51552/jars/io.netty_netty-codec-4.0.33.Final.jar with timestamp 1483418075392 | |
| 17/01/03 13:34:35 INFO SparkContext: Added JAR file:/Users/lambda/.ivy2/jars/io.netty_netty-common-4.0.33.Final.jar at http://10.0.0.26:51552/jars/io.netty_netty-common-4.0.33.Final.jar with timestamp 1483418075393 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/com.datastax.spark_spark-cassandra-connector_2.10-1.6.2.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/com.datastax.spark_spark-cassandra-connector_2.10-1.6.2.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/com.datastax.spark_spark-cassandra-connector_2.10-1.6.2.jar at file:/Users/lambda/.ivy2/jars/com.datastax.spark_spark-cassandra-connector_2.10-1.6.2.jar with timestamp 1483418075467 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/TargetHolding_pyspark-cassandra-0.3.5.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/TargetHolding_pyspark-cassandra-0.3.5.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/TargetHolding_pyspark-cassandra-0.3.5.jar at file:/Users/lambda/.ivy2/jars/TargetHolding_pyspark-cassandra-0.3.5.jar with timestamp 1483418075489 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/joda-time_joda-time-2.3.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/joda-time_joda-time-2.3.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/joda-time_joda-time-2.3.jar at file:/Users/lambda/.ivy2/jars/joda-time_joda-time-2.3.jar with timestamp 1483418075494 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/com.twitter_jsr166e-1.1.0.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/com.twitter_jsr166e-1.1.0.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/com.twitter_jsr166e-1.1.0.jar at file:/Users/lambda/.ivy2/jars/com.twitter_jsr166e-1.1.0.jar with timestamp 1483418075501 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/io.netty_netty-all-4.0.33.Final.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/io.netty_netty-all-4.0.33.Final.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/io.netty_netty-all-4.0.33.Final.jar at file:/Users/lambda/.ivy2/jars/io.netty_netty-all-4.0.33.Final.jar with timestamp 1483418075505 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/org.joda_joda-convert-1.2.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/org.joda_joda-convert-1.2.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/org.joda_joda-convert-1.2.jar at file:/Users/lambda/.ivy2/jars/org.joda_joda-convert-1.2.jar with timestamp 1483418075514 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/org.scala-lang_scala-reflect-2.10.5.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/org.scala-lang_scala-reflect-2.10.5.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/org.scala-lang_scala-reflect-2.10.5.jar at file:/Users/lambda/.ivy2/jars/org.scala-lang_scala-reflect-2.10.5.jar with timestamp 1483418075518 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/com.datastax.spark_spark-cassandra-connector-java_2.10-1.6.0-M1.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/com.datastax.spark_spark-cassandra-connector-java_2.10-1.6.0-M1.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/com.datastax.spark_spark-cassandra-connector-java_2.10-1.6.0-M1.jar at file:/Users/lambda/.ivy2/jars/com.datastax.spark_spark-cassandra-connector-java_2.10-1.6.0-M1.jar with timestamp 1483418075528 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/org.apache.cassandra_cassandra-clientutil-3.0.2.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/org.apache.cassandra_cassandra-clientutil-3.0.2.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/org.apache.cassandra_cassandra-clientutil-3.0.2.jar at file:/Users/lambda/.ivy2/jars/org.apache.cassandra_cassandra-clientutil-3.0.2.jar with timestamp 1483418075532 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/com.datastax.cassandra_cassandra-driver-core-3.0.0.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/com.datastax.cassandra_cassandra-driver-core-3.0.0.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/com.datastax.cassandra_cassandra-driver-core-3.0.0.jar at file:/Users/lambda/.ivy2/jars/com.datastax.cassandra_cassandra-driver-core-3.0.0.jar with timestamp 1483418075537 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/org.apache.commons_commons-lang3-3.3.2.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/org.apache.commons_commons-lang3-3.3.2.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/org.apache.commons_commons-lang3-3.3.2.jar at file:/Users/lambda/.ivy2/jars/org.apache.commons_commons-lang3-3.3.2.jar with timestamp 1483418075543 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/com.google.guava_guava-16.0.1.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/com.google.guava_guava-16.0.1.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/com.google.guava_guava-16.0.1.jar at file:/Users/lambda/.ivy2/jars/com.google.guava_guava-16.0.1.jar with timestamp 1483418075548 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/io.netty_netty-handler-4.0.33.Final.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/io.netty_netty-handler-4.0.33.Final.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/io.netty_netty-handler-4.0.33.Final.jar at file:/Users/lambda/.ivy2/jars/io.netty_netty-handler-4.0.33.Final.jar with timestamp 1483418075556 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/io.dropwizard.metrics_metrics-core-3.1.2.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/io.dropwizard.metrics_metrics-core-3.1.2.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/io.dropwizard.metrics_metrics-core-3.1.2.jar at file:/Users/lambda/.ivy2/jars/io.dropwizard.metrics_metrics-core-3.1.2.jar with timestamp 1483418075562 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/io.netty_netty-buffer-4.0.33.Final.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/io.netty_netty-buffer-4.0.33.Final.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/io.netty_netty-buffer-4.0.33.Final.jar at file:/Users/lambda/.ivy2/jars/io.netty_netty-buffer-4.0.33.Final.jar with timestamp 1483418075567 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/io.netty_netty-transport-4.0.33.Final.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/io.netty_netty-transport-4.0.33.Final.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/io.netty_netty-transport-4.0.33.Final.jar at file:/Users/lambda/.ivy2/jars/io.netty_netty-transport-4.0.33.Final.jar with timestamp 1483418075572 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/io.netty_netty-codec-4.0.33.Final.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/io.netty_netty-codec-4.0.33.Final.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/io.netty_netty-codec-4.0.33.Final.jar at file:/Users/lambda/.ivy2/jars/io.netty_netty-codec-4.0.33.Final.jar with timestamp 1483418075576 | |
| 17/01/03 13:34:35 INFO Utils: Copying /Users/lambda/.ivy2/jars/io.netty_netty-common-4.0.33.Final.jar to /private/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/spark-5c9d7a32-6ada-459d-8e8c-8f9fc472685b/userFiles-4fc3ef24-dad2-46bd-bd46-55430feea5fd/io.netty_netty-common-4.0.33.Final.jar | |
| 17/01/03 13:34:35 INFO SparkContext: Added file file:/Users/lambda/.ivy2/jars/io.netty_netty-common-4.0.33.Final.jar at file:/Users/lambda/.ivy2/jars/io.netty_netty-common-4.0.33.Final.jar with timestamp 1483418075580 | |
| 17/01/03 13:34:35 INFO Executor: Starting executor ID driver on host localhost | |
| 17/01/03 13:34:35 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 51554. | |
| 17/01/03 13:34:35 INFO NettyBlockTransferService: Server created on 51554 | |
| 17/01/03 13:34:35 INFO BlockManagerMaster: Trying to register BlockManager | |
| 17/01/03 13:34:35 INFO BlockManagerMasterEndpoint: Registering block manager localhost:51554 with 511.1 MB RAM, BlockManagerId(driver, localhost, 51554) | |
| 17/01/03 13:34:35 INFO BlockManagerMaster: Registered BlockManager | |
| Welcome to | |
| ____ __ | |
| / __/__ ___ _____/ /__ | |
| _\ \/ _ \/ _ `/ __/ '_/ | |
| /__ / .__/\_,_/_/ /_/\_\ version 1.6.2 | |
| /_/ | |
| Using Python version 2.7.12 (default, Dec 16 2016 13:04:21) | |
| SparkContext available as sc, HiveContext available as sqlContext. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment