Skip to content

Instantly share code, notes, and snippets.

@cmeiklejohn
Created November 19, 2016 16:52
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save cmeiklejohn/6aeee878be045f4f05c58d98d42bbb32 to your computer and use it in GitHub Desktop.
Save cmeiklejohn/6aeee878be045f4f05c58d98d42bbb32 to your computer and use it in GitHub Desktop.
16/11/19 17:50:21 INFO DAGScheduler: Job 0 finished: foreach at SimpleApp.scala:112, took 149.144955 s
1) Average: 2.996151184061866
2) Averages by languages:
en: 4.745498054726365
sp: 0.0
fr: 1.2194657511446376
pr: 0.0
it: 1.3628844266317683
3) Number of pages viewed more than 5: 359946
4) Percentage of pages for each language in languages
en: 0.368302093899954
sp: 0.0
fr: 0.06864870810776684
pr: 0.0
it: 0.018941581426838994
Exception in thread "main" java.lang.NoClassDefFoundError: shadeio/common/reflect/TypeParameter
at com.datastax.driver.core.SanityChecks.checkGuava(SanityChecks.java:50)
at com.datastax.driver.core.SanityChecks.check(SanityChecks.java:36)
at com.datastax.driver.core.Cluster.<clinit>(Cluster.java:67)
at com.websudos.phantom.connectors.DefaultSessionProvider.<init>(DefaultSessionProvider.scala:31)
at com.websudos.phantom.connectors.KeySpaceDef.<init>(Keyspace.scala:63)
at com.websudos.phantom.connectors.KeySpaceBuilder.keySpace(KeySpaceBuilder.scala:53)
at CustomConnector$.<init>(Database.scala:10)
at CustomConnector$.<clinit>(Database.scala)
at Cassandra$.com$websudos$phantom$connectors$KeySpaceDef$Connector$$$outer(Cassandra.scala)
at com.websudos.phantom.connectors.KeySpaceDef$Connector$class.$init$(Keyspace.scala:122)
at Cassandra$.<init>(Cassandra.scala:12)
at Cassandra$.<clinit>(Cassandra.scala)
at SimpleApp$.interestingQuestions(SimpleApp.scala:152)
at SimpleApp$.main(SimpleApp.scala:58)
at SimpleApp.main(SimpleApp.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:736)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:124)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.ClassNotFoundException: shadeio.common.reflect.TypeParameter
at java.net.URLClassLoader$1.run(URLClassLoader.java:372)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:360)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 24 more
16/11/19 17:50:21 INFO SparkContext: Invoking stop() from shutdown hook
16/11/19 17:50:21 INFO SparkUI: Stopped Spark web UI at http://192.168.0.13:4040
16/11/19 17:50:21 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
16/11/19 17:50:21 INFO MemoryStore: MemoryStore cleared
16/11/19 17:50:21 INFO BlockManager: BlockManager stopped
16/11/19 17:50:21 INFO BlockManagerMaster: BlockManagerMaster stopped
16/11/19 17:50:21 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
16/11/19 17:50:21 INFO SparkContext: Successfully stopped SparkContext
16/11/19 17:50:21 INFO ShutdownHookManager: Shutdown hook called
16/11/19 17:50:21 INFO ShutdownHookManager: Deleting directory /private/var/folders/dm/mdzr55c97898h4232_14lkdr0000gn/T/spark-7186bb96-6e35-4f95-9b7b-247396b87931
Christophers-MacBook-Pro:code cmeiklejohn$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment