aajisaka

$ mvn process-sources javadoc:javadoc-no-fork -pl hadoop-common-project/hadoop-common 
(snip)
[INFO] 
27 errors
100 warnings
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  42.681 s
[INFO] Finished at: 2020-08-03T11:09:22+09:00

aajisaka

[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.mapred.TestCombineFileInputFormat
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.341 s - in org.apache.hadoop.mapred.TestCombineFileInputFormat
[INFO] Running org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat
[ERROR] Tests run: 10, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 30.916 s <<< FAILURE! - in org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat
[ERROR] testMissingBlocks(org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat)  Time elapsed: 0.59 s  <<< ERROR!
java.lang.ClassCastException: org.apache.hadoop.hdfs.DistributedFileSystem cannot be cast to org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat$MissingBlockFileSystem
	at org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat.testMissingBlocks(TestCombineFileInputFormat.java:1655)

aajisaka

[INFO] --- frontend-maven-plugin:1.6:bower (bower install) @ hadoop-yarn-ui ---
[INFO] Running 'bower install' in /home/aajisaka/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/target/webapp
[INFO] 
[INFO] --- exec-maven-plugin:1.3.1:exec (ember build) @ hadoop-yarn-ui ---
fs.js:35
} = primordials;
    ^

ReferenceError: primordials is not defined
    at fs.js:35:5

aajisaka

WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by com.google.inject.internal.cglib.core.$ReflectUtils$1 (file:/usr/share/maven/lib/guice.jar) to method java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
WARNING: Please consider reporting this to the maintainers of com.google.inject.internal.cglib.core.$ReflectUtils$1
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
[INFO] Error stacktraces are turned on.
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Detecting the operating system and CPU architecture
[INFO] ------------------------------------------------------------------------

aajisaka

[WARNING] make[1]: *** [CMakeFiles/Makefile2:2293: main/native/libhdfspp/lib/proto/CMakeFiles/proto_obj.dir/all] Error 2
[WARNING] make[1]: *** Waiting for unfinished jobs....
[WARNING] In file included from /home/aajisaka/git/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/third_party/gmock-1.7.0/gmock-gtest-all.cc:9632:
[WARNING] /home/aajisaka/git/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/third_party/gmock-1.7.0/gmock/gmock.h: In instantiation of ‘testing::PolymorphicMatcher<Impl>::PolymorphicMatcher(const Impl&) [with Impl = testing::internal::StrEqualityMatcher<std::__cxx11::basic_string<char> >]’:
[WARNING] /home/aajisaka/git/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/third_party/gmock-1.7.0/gmock/gmock.h:5124:10:   required from ‘testing::PolymorphicMatcher<Impl> testing::MakePolymorphicMatcher(const Impl&) [with Impl = testing::internal::StrEqualityMatcher<std::__cxx11::basic_string<char> >]’
[WARNI

aajisaka

#!/usr/bin/env bash

YETUSDIR=${WORKSPACE}/yetus
ARTIFACTS=${WORKSPACE}/out
BASEDIR=${WORKSPACE}/sourcedir
TOOLS=${WORKSPACE}/tools
rm -rf "${ARTIFACTS}" "${YETUSDIR}"
mkdir -p "${ARTIFACTS}" "${YETUSDIR}" "${TOOLS}"

if [[ -d /sys/fs/cgroup/pids/user.slice ]]; then

aajisaka

[INFO] Results:
[INFO] 
[ERROR] Failures: 
[ERROR]   TestDistCacheEmulation.testGenerateDistCacheData:258 GenerateDistCacheData job failed.
[ERROR]   TestGridmixSubmission.testReplaySubmit:160->CommonJobTest.doSubmission:375 Client exited with nonzero status expected:<0> but was:<2>
[ERROR]   TestGridmixSubmission.testStressSubmit:169->CommonJobTest.doSubmission:375 Client exited with nonzero status expected:<0> but was:<2>
[ERROR]   TestLoadJob.testReplaySubmit:76->CommonJobTest.doSubmission:375 Client exited with nonzero status expected:<0> but was:<2>
[ERROR]   TestLoadJob.testSerialSubmit:64->CommonJobTest.doSubmission:375 Client exited with nonzero status expected:<0> but was:<2>
[ERROR]   TestSleepJob.testReplaySubmit:107->CommonJobTest.doSubmission:375 Client exited with nonzero status expected:<0> but was:<2>
[ERROR]   TestSleepJob.testSerialSubmit:99->CommonJobTest.doSubmission:375 Client exited with nonzero status expected:<0> but was:<2>

aajisaka

     [exec]       Start  8: memcheck_remote_block_reader
     [exec]  8/40 Test  #8: memcheck_remote_block_reader ...............................***Exception: SegFault  1.96 sec
     [exec] ==31666== Memcheck, a memory error detector
     [exec] ==31666== Copyright (C) 2002-2017, and GNU GPL'd, by Julian Seward et al.
     [exec] ==31666== Using Valgrind-3.13.0 and LibVEX; rerun with -h for copyright info
     [exec] ==31666== Command: ./remote_block_reader_test
     [exec] ==31666== 
     [exec] [==========] Running 9 tests from 1 test case.
     [exec] [----------] Global test environment set-up.
     [exec] [----------] 9 tests from RemoteBlockReaderTest

aajisaka

## before (it shows authentication failure occurred)

2020-01-08 13:44:51,615 ERROR org.apache.hadoop.hdfs.server.federation.router.FederationUtil: Cannot read JMX bean Hadoop:service=NameNode,name=FSNamesystem* from server <namenode>:9871: Error while authenticating with endpoint: https://<namenode>:9871/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem*

## after: (it shows why the authentication failure occurred)

2020-01-08 17:01:35,154 ERROR org.apache.hadoop.hdfs.server.federation.router.FederationUtil: Cannot read JMX bean Hadoop:service=NameNode,name=FSNamesystem* from server <namenode>:9871:
javax.net.ssl.SSLHandshakeException: Error while authenticating with endpoint: https://<namenode>:9871/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem*
        at java.base/jdk.internal.reflect.GeneratedConstructorAccessor45.newInstance(Unknown Source)
        at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

aajisaka

2019-09-11 18:08:30,411 DEBUG org.eclipse.jetty.util.component.ContainerLifeCycle: org.eclipse.jetty.servlet.ServletHandler@b2c9a9c added {NoCacheFilter,AUTO}
2019-09-11 18:08:30,413 DEBUG org.eclipse.jetty.util.component.ContainerLifeCycle: org.eclipse.jetty.servlet.ServletHandler@b2c9a9c added {[/*]/[]==31=>NoCacheFilter,POJO}
2019-09-11 18:08:30,453 DEBUG org.eclipse.jetty.util.component.ContainerLifeCycle: org.eclipse.jetty.servlet.ServletHandler@71def8f8 added {NoCacheFilter,AUTO}
2019-09-11 18:08:30,453 DEBUG org.eclipse.jetty.util.component.ContainerLifeCycle: org.eclipse.jetty.servlet.ServletHandler@71def8f8 added {[/*]/[]==31=>NoCacheFilter,POJO}
2019-09-11 18:08:30,457 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2019-09-11 18:08:30,457 INFO org.apache.hadoop.conf.ConfigurationWithLogging: Got hadoop.http.filter.initializers = 'org.apache.hadoop.security.AuthenticationFilterInitializer,org.apache.hadoop.http.lib.S