Skip to content

Instantly share code, notes, and snippets.

@qiaohaijun

qiaohaijun/hdfs c++ 访问 debug 日志.md

Last active January 6, 2016 10:20
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save qiaohaijun/983f9cc2855329e7119e to your computer and use it in GitHub Desktop.
Save qiaohaijun/983f9cc2855329e7119e to your computer and use it in GitHub Desktop.
Download ZIP
Raw
hdfs c++ 访问 debug 日志.md

有一点需要注意的是不要讲libjvm.so libjava.so 这类so拷贝到本地，如果没有，就用LD_LIBRARY_PATH

[@rsync.gpu01.research.nm.nop.sogou-op.org cpp]# ./test_hdfs 
loadFileSystems error:
java.lang.NoClassDefFoundError: org/apache/hadoop/fs/FileSystem
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.fs.FileSystem
	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
hdfsBuilderConnect(forceNewInstance=0, nn=192.168.1.8, port=9000, kerbTicketCachePath=(NULL), userName=(NULL)) error:
java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration
	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
hdfsOpenFile(/tmp/testfile.txt): constructNewObjectOfPath error:
java.lang.NoClassDefFoundError: org/apache/hadoop/fs/Path
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.fs.Path
	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
Failed to open /tmp/testfile.txt for writing!

org/apache/hadoop/fs/FileSystem

export CLASSPATH=$CLASSPATH:/usr/lib/hadoop/hadoop-common-2.5.0-cdh5.3.2.jar
[@rsync.gpu01.research.nm.nop.sogou-op.org cpp]# ./test_hdfs 
loadFileSystems error:
java.lang.NoClassDefFoundError: org/apache/commons/logging/LogFactory
	at org.apache.hadoop.fs.FileSystem.<clinit>(FileSystem.java:97)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.logging.LogFactory
	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
	... 1 more
hdfsBuilderConnect(forceNewInstance=0, nn=192.168.1.8, port=9000, kerbTicketCachePath=(NULL), userName=(NULL)) error:
java.lang.NoClassDefFoundError: org/apache/commons/logging/LogFactory
	at org.apache.hadoop.conf.Configuration.<clinit>(Configuration.java:172)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.logging.LogFactory
	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
	... 1 more
hdfsOpenFile(/tmp/testfile.txt): FileSystem#getConf error:
java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.fs.FileSystem
Failed to open /tmp/testfile.txt for writing!

org/apache/commons/logging/LogFactory

 export CLASSPATH=$CLASSPATH:/usr/share/maven/lib/commons-logging.jar
@qiaohaijun
Copy link
Author 

[@rsync.gpu01.research.nm.nop.sogou-op.org cpp]# ./test_hdfs 
loadFileSystems error:
java.util.ServiceConfigurationError: org.apache.hadoop.fs.FileSystem: Provider org.apache.hadoop.fs.viewfs.ViewFileSystem could not be instantiated
    at java.util.ServiceLoader.fail(ServiceLoader.java:224)
    at java.util.ServiceLoader.access$100(ServiceLoader.java:181)
    at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:377)
    at java.util.ServiceLoader$1.next(ServiceLoader.java:445)
    at org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:2563)
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/configuration/Configuration
    at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<init>(DefaultMetricsSystem.java:38)
    at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<clinit>(DefaultMetricsSystem.java:36)
    at org.apache.hadoop.security.UserGroupInformation$UgiMetrics.create(UserGroupInformation.java:138)
    at org.apache.hadoop.security.UserGroupInformation.<clinit>(UserGroupInformation.java:390)
    at org.apache.hadoop.fs.viewfs.ViewFileSystem.<init>(ViewFileSystem.java:134)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
    at java.lang.Class.newInstance(Class.java:379)
    at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:373)
    ... 2 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.configuration.Configuration
    at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
    ... 13 more
hdfsBuilderConnect(forceNewInstance=0, nn=192.168.1.8, port=9000, kerbTicketCachePath=(NULL), userName=(NULL)) error:
java.lang.NoClassDefFoundError: com/google/common/base/Preconditions
    at org.apache.hadoop.conf.Configuration$DeprecationDelta.<init>(Configuration.java:321)
    at org.apache.hadoop.conf.Configuration$DeprecationDelta.<init>(Configuration.java:334)
    at org.apache.hadoop.conf.Configuration.<clinit>(Configuration.java:416)
Caused by: java.lang.ClassNotFoundException: com.google.common.base.Preconditions
    at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
    ... 3 more
hdfsOpenFile(/tmp/testfile.txt): FileSystem#getConf error:
java.lang.NullPointerException
Failed to open /tmp/testfile.txt for writing!

@qiaohaijun
Copy link
Author

@rsync.gpu01.research.nm.nop.sogou-op.org cpp]# export CLASSPATH=$CLASSPATH:/usr/lib/hadoop/client/commons-configuration-1.6.jar

@qiaohaijun
Copy link
Author

[@rsync.gpu01.research.nm.nop.sogou-op.org cpp]# ./test_hdfs
loadFileSystems error:
java.util.ServiceConfigurationError: org.apache.hadoop.fs.FileSystem: Provider org.apache.hadoop.fs.viewfs.ViewFileSystem could not be instantiated
at java.util.ServiceLoader.fail(ServiceLoader.java:224)
at java.util.ServiceLoader.access$100(ServiceLoader.java:181)
at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:377)
at java.util.ServiceLoader$1.next(ServiceLoader.java:445)
at org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:2563)
Caused by: java.lang.NoClassDefFoundError: com/google/common/collect/Maps
at org.apache.hadoop.metrics2.lib.MetricsRegistry.(MetricsRegistry.java:42)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.(MetricsSystemImpl.java:88)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.(MetricsSystemImpl.java:134)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.(DefaultMetricsSystem.java:38)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.(DefaultMetricsSystem.java:36)
at org.apache.hadoop.security.UserGroupInformation$UgiMetrics.create(UserGroupInformation.java:138)
at org.apache.hadoop.security.UserGroupInformation.(UserGroupInformation.java:390)
at org.apache.hadoop.fs.viewfs.ViewFileSystem.(ViewFileSystem.java:134)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at java.lang.Class.newInstance(Class.java:379)
at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:373)
... 2 more
Caused by: java.lang.ClassNotFoundException: com.google.common.collect.Maps
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 16 more
hdfsBuilderConnect(forceNewInstance=0, nn=192.168.1.8, port=9000, kerbTicketCachePath=(NULL), userName=(NULL)) error:
java.lang.NoClassDefFoundError: com/google/common/base/Preconditions
at org.apache.hadoop.conf.Configuration$DeprecationDelta.(Configuration.java:321)
at org.apache.hadoop.conf.Configuration$DeprecationDelta.(Configuration.java:334)
at org.apache.hadoop.conf.Configuration.(Configuration.java:416)
Caused by: java.lang.ClassNotFoundException: com.google.common.base.Preconditions
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 3 more
hdfsOpenFile(/tmp/testfile.txt): FileSystem#getConf error:
java.lang.NullPointerException
Failed to open /tmp/testfile.txt for writing!

@qiaohaijun
Copy link
Author

export CLASSPATH=$CLASSPATH:/root/.m2/repository/com/google/collections/google-collections/1.0/google-collections-1.0.jar

@qiaohaijun
Copy link
Author

[@rsync.gpu01.research.nm.nop.sogou-op.org cpp]# ./test_hdfs
loadFileSystems error:
java.util.ServiceConfigurationError: org.apache.hadoop.fs.FileSystem: Provider org.apache.hadoop.fs.viewfs.ViewFileSystem could not be instantiated
at java.util.ServiceLoader.fail(ServiceLoader.java:224)
at java.util.ServiceLoader.access$100(ServiceLoader.java:181)
at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:377)
at java.util.ServiceLoader$1.next(ServiceLoader.java:445)
at org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:2563)
Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/util/PlatformName
at org.apache.hadoop.security.UserGroupInformation.getOSLoginModuleName(UserGroupInformation.java:593)
at org.apache.hadoop.security.UserGroupInformation.(UserGroupInformation.java:638)
at org.apache.hadoop.fs.viewfs.ViewFileSystem.(ViewFileSystem.java:134)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at java.lang.Class.newInstance(Class.java:379)
at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:373)
... 2 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 11 more
hdfsBuilderConnect(forceNewInstance=0, nn=192.168.1.8, port=9000, kerbTicketCachePath=(NULL), userName=(NULL)) error:
java.lang.NoClassDefFoundError: org/apache/commons/collections/map/UnmodifiableMap
at org.apache.hadoop.conf.Configuration$DeprecationContext.(Configuration.java:401)
at org.apache.hadoop.conf.Configuration.(Configuration.java:441)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.collections.map.UnmodifiableMap
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 2 more
hdfsOpenFile(/tmp/testfile.txt): FileSystem#getConf error:
java.lang.NullPointerException
Failed to open /tmp/testfile.txt for writing!

@qiaohaijun
Copy link
Author

/root/.ivy2/cache/org.apache.hadoop/hadoop-auth/jars/hadoop-auth-2.7.1.jar

@qiaohaijun
Copy link
Author

/usr/lib/hadoop/hadoop-auth-2.5.0-cdh5.3.2.jar
/usr/lib/hadoop/hadoop-auth.jar
/usr/lib/hadoop/client/hadoop-auth-2.5.0-cdh5.3.2.jar
/usr/lib/hadoop/client/hadoop-auth.jar

@qiaohaijun
Copy link
Author

Caused by: java.lang.NoClassDefFoundError: org/apache/commons/collections/map/UnmodifiableMap

@qiaohaijun
Copy link
Author

[@rsync.gpu01.research.nm.nop.sogou-op.org cpp]# ./test_hdfs
loadFileSystems error:
java.util.ServiceConfigurationError: org.apache.hadoop.fs.FileSystem: Provider org.apache.hadoop.fs.viewfs.ViewFileSystem could not be instantiated
at java.util.ServiceLoader.fail(ServiceLoader.java:224)
at java.util.ServiceLoader.access$100(ServiceLoader.java:181)
at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:377)
at java.util.ServiceLoader$1.next(ServiceLoader.java:445)
at org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:2563)
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/collections/map/UnmodifiableMap
at org.apache.hadoop.conf.Configuration$DeprecationContext.(Configuration.java:401)
at org.apache.hadoop.conf.Configuration.(Configuration.java:441)
at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:424)
at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:1018)
at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:1003)
at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:876)
at org.apache.hadoop.fs.viewfs.ViewFileSystem.(ViewFileSystem.java:134)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at java.lang.Class.newInstance(Class.java:379)
at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:373)
... 2 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.collections.map.UnmodifiableMap
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 15 more
hdfsBuilderConnect(forceNewInstance=0, nn=192.168.1.8, port=9000, kerbTicketCachePath=(NULL), userName=(NULL)) error:
java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.conf.Configuration
hdfsOpenFile(/tmp/testfile.txt): FileSystem#getConf error:
java.lang.NullPointerException
Failed to open /tmp/testfile.txt for writing!

@qiaohaijun
Copy link
Author

/usr/lib/ambari-server/commons-collections-3.2.1.jar
/usr/lib/hadoop/client/commons-collections-3.2.1.jar
/usr/lib/hadoop/client/commons-collections.jar
/usr/lib/hadoop/client-0.20/commons-collections-3.2.1.jar
/usr/lib/hadoop/client-0.20/commons-collections.jar
/usr/lib/hadoop/lib/commons-collections-3.2.1.jar
/usr/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar
/usr/lib/hadoop-mapreduce/commons-collections-3.2.1.jar
/usr/lib/hadoop-yarn/lib/commons-collections-3.2.1.jar
/usr/lib/hbase/lib/commons-collections-3.2.2.jar

@qiaohaijun
Copy link
Author

[@rsync.gpu01.research.nm.nop.sogou-op.org cpp]# ./test_hdfs
loadFileSystems error:
java.util.ServiceConfigurationError: org.apache.hadoop.fs.FileSystem: Provider org.apache.hadoop.fs.viewfs.ViewFileSystem could not be instantiated
at java.util.ServiceLoader.fail(ServiceLoader.java:224)
at java.util.ServiceLoader.access$100(ServiceLoader.java:181)
at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:377)
at java.util.ServiceLoader$1.next(ServiceLoader.java:445)
at org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:2563)
Caused by: java.lang.NoClassDefFoundError: com/google/common/collect/Interners
at org.apache.hadoop.util.StringInterner.(StringInterner.java:48)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2460)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2352)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2269)
at org.apache.hadoop.conf.Configuration.get(Configuration.java:869)
at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:480)
at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:424)
at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:1018)
at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:1003)
at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:876)
at org.apache.hadoop.fs.viewfs.ViewFileSystem.(ViewFileSystem.java:134)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at java.lang.Class.newInstance(Class.java:379)
at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:373)
... 2 more
Caused by: java.lang.ClassNotFoundException: com.google.common.collect.Interners
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 19 more
hdfsBuilderConnect(forceNewInstance=0, nn=192.168.1.8, port=9000, kerbTicketCachePath=(NULL), userName=(NULL)) error:
java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.util.StringInterner
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2460)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2352)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2269)
at org.apache.hadoop.conf.Configuration.get(Configuration.java:869)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:152)
hdfsOpenFile(/tmp/testfile.txt): FileSystem#getConf error:
java.lang.NullPointerException
Failed to open /tmp/testfile.txt for writing!

@qiaohaijun
Copy link
Author

/usr/lib/ambari-server/guava-14.0.1.jar
/usr/lib/hadoop/client/guava-11.0.2.jar
/usr/lib/hadoop/client/guava.jar
/usr/lib/hadoop/client-0.20/guava-11.0.2.jar
/usr/lib/hadoop/client-0.20/guava.jar
/usr/lib/hadoop/lib/guava-11.0.2.jar
/usr/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar
/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar
/usr/lib/hadoop-mapreduce/guava-11.0.2.jar
/usr/lib/hadoop-yarn/lib/guava-11.0.2.jar
/usr/lib/hbase/lib/guava-12.0.1.jar

@qiaohaijun
Copy link
Author

/usr/lib/hadoop/client/guava.jar 这个是关键 commons-xx

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment