Skip to content

Instantly share code, notes, and snippets.

@wobu
Created August 17, 2016 14:11
Show Gist options
  • Save wobu/e6566bb2387823964c7627ddd98dbc35 to your computer and use it in GitHub Desktop.
Save wobu/e6566bb2387823964c7627ddd98dbc35 to your computer and use it in GitHub Desktop.
Spark MapR LinkageError MapRPut
16/08/17 14:41:17 INFO HFileOutputFormat2: detected MapR table /mapr/dev-hadoop01-samham/firstaid/Developer1/tables/rescoredDocPref, switching to BulkLoadRecordWriter
16/08/17 14:41:17 ERROR Executor: Exception in task 0.0 in stage 2.2 (TID 514)
java.lang.LinkageError: loader constraint violation: when resolving method "com.mapr.fs.jni.MapRPut.<init>(Ljava/lang/Object;Lcom/mapr/fs/jni/MapRCallBackQueue;)V" the class loader (instance of org/apache/spark/util/MutableURLClassLoader) of the current class, com/mapr/fs/hbase/PutConverter, and the class loader (instance of sun/misc/Launcher$ExtClassLoader) for the method's defining class, com/mapr/fs/jni/MapRPut, have different Class objects for the type com/mapr/fs/jni/MapRCallBackQueue used in the signature
at com.mapr.fs.hbase.PutConverter.createMapRPut(PutConverter.java:124)
at com.mapr.fs.hbase.PutConverter.sortedKeyValuesToMapRPut(PutConverter.java:106)
at com.mapr.fs.hbase.BulkLoadRecordWriter.appendRow(BulkLoadRecordWriter.java:123)
at com.mapr.fs.hbase.BulkLoadRecordWriter.close(BulkLoadRecordWriter.java:167)
at org.apache.spark.rdd.PairRDDFunctions$$anonfun$12.apply(PairRDDFunctions.scala:1007)
at org.apache.spark.rdd.PairRDDFunctions$$anonfun$12.apply(PairRDDFunctions.scala:979)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
16/08/17 14:41:17 ERROR SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[Executor task launch worker-8,5,main]
java.lang.LinkageError: loader constraint violation: when resolving method "com.mapr.fs.jni.MapRPut.<init>(Ljava/lang/Object;Lcom/mapr/fs/jni/MapRCallBackQueue;)V" the class loader (instance of org/apache/spark/util/MutableURLClassLoader) of the current class, com/mapr/fs/hbase/PutConverter, and the class loader (instance of sun/misc/Launcher$ExtClassLoader) for the method's defining class, com/mapr/fs/jni/MapRPut, have different Class objects for the type com/mapr/fs/jni/MapRCallBackQueue used in the signature
at com.mapr.fs.hbase.PutConverter.createMapRPut(PutConverter.java:124)
at com.mapr.fs.hbase.PutConverter.sortedKeyValuesToMapRPut(PutConverter.java:106)
at com.mapr.fs.hbase.BulkLoadRecordWriter.appendRow(BulkLoadRecordWriter.java:123)
at com.mapr.fs.hbase.BulkLoadRecordWriter.close(BulkLoadRecordWriter.java:167)
at org.apache.spark.rdd.PairRDDFunctions$$anonfun$12.apply(PairRDDFunctions.scala:1007)
at org.apache.spark.rdd.PairRDDFunctions$$anonfun$12.apply(PairRDDFunctions.scala:979)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
at org.apache.spark.scheduler.Task.run(Task.scala:64)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment