gistfile1.txt

➜  lesson01  ../spark-bin/bin/spark-submit --class=com.mkdev.lesson01.KafkaSimpleStreamer ./target/lesson01-1.0-SNAPSHOT.jar localhost:2181 test test 1
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
15/09/24 17:54:00 INFO SparkContext: Running Spark version 1.5.0
15/09/24 17:54:01 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
15/09/24 17:54:02 INFO SecurityManager: Changing view acls to: kshirinkin
15/09/24 17:54:02 INFO SecurityManager: Changing modify acls to: kshirinkin
15/09/24 17:54:02 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(kshirinkin); users with modify permissions: Set(kshirinkin)
15/09/24 17:54:03 INFO Slf4jLogger: Slf4jLogger started
15/09/24 17:54:03 INFO Remoting: Starting remoting
15/09/24 17:54:03 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriver@10.90.26.94:60798]
15/09/24 17:54:03 INFO Utils: Successfully started service 'sparkDriver' on port 60798.
15/09/24 17:54:03 INFO SparkEnv: Registering MapOutputTracker
15/09/24 17:54:03 INFO SparkEnv: Registering BlockManagerMaster
15/09/24 17:54:03 INFO DiskBlockManager: Created local directory at /private/var/folders/l4/f68myc1d22dd1dx7hr2wzd7r0000gp/T/blockmgr-fa5e3e2c-6b55-4673-95ef-4c0afa7036a4
15/09/24 17:54:03 INFO MemoryStore: MemoryStore started with capacity 530.0 MB
15/09/24 17:54:03 INFO HttpFileServer: HTTP File server directory is /private/var/folders/l4/f68myc1d22dd1dx7hr2wzd7r0000gp/T/spark-255dc24a-e783-4032-a3d5-8514930b14f3/httpd-baf7fe81-ed1c-462b-9892-4e91aa2fafce
15/09/24 17:54:03 INFO HttpServer: Starting HTTP Server
15/09/24 17:54:04 INFO Utils: Successfully started service 'HTTP file server' on port 60799.
15/09/24 17:54:04 INFO SparkEnv: Registering OutputCommitCoordinator
15/09/24 17:54:04 INFO Utils: Successfully started service 'SparkUI' on port 4040.
15/09/24 17:54:04 INFO SparkUI: Started SparkUI at http://10.90.26.94:4040
15/09/24 17:54:04 INFO SparkContext: Added JAR file:/Users/kshirinkin/work/fjcorp/mkdev-bigdata.course/lesson01/./target/lesson01-1.0-SNAPSHOT.jar at http://10.90.26.94:60799/jars/lesson01-1.0-SNAPSHOT.jar with timestamp 1443110044315
15/09/24 17:54:04 WARN MetricsSystem: Using default name DAGScheduler for source because spark.app.id is not set.
15/09/24 17:54:04 INFO Executor: Starting executor ID driver on host localhost
15/09/24 17:54:04 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 60800.
15/09/24 17:54:04 INFO NettyBlockTransferService: Server created on 60800
15/09/24 17:54:04 INFO BlockManagerMaster: Trying to register BlockManager
15/09/24 17:54:04 INFO BlockManagerMasterEndpoint: Registering block manager localhost:60800 with 530.0 MB RAM, BlockManagerId(driver, localhost, 60800)
15/09/24 17:54:04 INFO BlockManagerMaster: Registered BlockManager
Exception in thread "main" java.lang.NoSuchMethodError: scala.Predef$.$conforms()Lscala/Predef$$less$colon$less;
	at com.mkdev.lesson01.KafkaSimpleStreamer$.main(App.scala:37)
	at com.mkdev.lesson01.KafkaSimpleStreamer.main(App.scala)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:672)
	at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180)
	at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:120)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
15/09/24 17:54:05 INFO SparkContext: Invoking stop() from shutdown hook
15/09/24 17:54:05 INFO SparkUI: Stopped Spark web UI at http://10.90.26.94:4040
15/09/24 17:54:05 INFO DAGScheduler: Stopping DAGScheduler
15/09/24 17:54:05 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
15/09/24 17:54:05 INFO MemoryStore: MemoryStore cleared
15/09/24 17:54:05 INFO BlockManager: BlockManager stopped
15/09/24 17:54:05 INFO BlockManagerMaster: BlockManagerMaster stopped
15/09/24 17:54:05 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
15/09/24 17:54:05 INFO SparkContext: Successfully stopped SparkContext
15/09/24 17:54:05 INFO ShutdownHookManager: Shutdown hook called
15/09/24 17:54:05 INFO ShutdownHookManager: Deleting directory /private/var/folders/l4/f68myc1d22dd1dx7hr2wzd7r0000gp/T/spark-255dc24a-e783-4032-a3d5-8514930b14f3