Akira Ajisaka aajisaka
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import java.io.IOException; | |
| import java.util.StringTokenizer; | |
| import org.apache.hadoop.conf.Configuration; | |
| import org.apache.hadoop.fs.Path; | |
| import org.apache.hadoop.io.IntWritable; | |
| import org.apache.hadoop.io.Text; | |
| import org.apache.hadoop.mapreduce.Job; | |
| import org.apache.hadoop.mapreduce.Mapper; | |
| import org.apache.hadoop.mapreduce.Reducer; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ➜ hadoop git:(trunk) ~/git/yetus/precommit/src/main/shell/test-patch.sh --personality="./dev-support/bin/hadoop.sh" --debug YARN-10507 | |
| [Tue Dec 1 20:40:54 JST 2020 DEBUG]: Importing /Users/aajisaka/git/yetus/precommit/src/main/shell/robots.d/azurepipelines.sh | |
| [Tue Dec 1 20:40:54 JST 2020 DEBUG]: Importing /Users/aajisaka/git/yetus/precommit/src/main/shell/robots.d/buildkite.sh | |
| [Tue Dec 1 20:40:54 JST 2020 DEBUG]: Importing /Users/aajisaka/git/yetus/precommit/src/main/shell/robots.d/circleci.sh | |
| [Tue Dec 1 20:40:54 JST 2020 DEBUG]: Importing /Users/aajisaka/git/yetus/precommit/src/main/shell/robots.d/cirrusci.sh | |
| [Tue Dec 1 20:40:54 JST 2020 DEBUG]: Importing /Users/aajisaka/git/yetus/precommit/src/main/shell/robots.d/githubactions.sh | |
| [Tue Dec 1 20:40:54 JST 2020 DEBUG]: Importing /Users/aajisaka/git/yetus/precommit/src/main/shell/robots.d/gitlabci.sh | |
| [Tue Dec 1 20:40:54 JST 2020 DEBUG]: Importing /Users/aajisaka/git/yetus/precommit/src/main/shell/robots.d/jenkins.sh | |
| [Tue Dec 1 20:40:54 JST 2020 DEBUG]: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [INFO] Running org.apache.hadoop.net.TestDNS | |
| [ERROR] Tests run: 12, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 0.403 s <<< FAILURE! - in org.apache.hadoop.net.TestDNS | |
| [ERROR] testNullDnsServer(org.apache.hadoop.net.TestDNS) Time elapsed: 0.134 s <<< ERROR! | |
| java.io.UncheckedIOException: java.net.SocketException: Unsupported address type | |
| at java.base/sun.nio.ch.DatagramSocketAdaptor.connect(DatagramSocketAdaptor.java:120) | |
| at java.base/java.net.DatagramSocket.connect(DatagramSocket.java:341) | |
| at jdk.naming.dns/com.sun.jndi.dns.DnsClient.doUdpQuery(DnsClient.java:408) | |
| at jdk.naming.dns/com.sun.jndi.dns.DnsClient.query(DnsClient.java:214) | |
| at jdk.naming.dns/com.sun.jndi.dns.Resolver.query(Resolver.java:81) | |
| at jdk.naming.dns/com.sun.jndi.dns.DnsContext.c_getAttributes(DnsContext.java:434) |
aajisaka
/ hadoop-bundled-jars-trunk.txt
Last active
September 19, 2020 15:41
find . -name "*.jar" | xargs -n1 basename | sort | uniq | grep -v 3.3.0-SNAPSHOT | pbcopy
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 20200115 | |
| -------- | |
| HikariCP-java7-2.4.12.jar | |
| accessors-smart-1.2.jar | |
| aliyun-java-sdk-core-3.4.0.jar | |
| aliyun-java-sdk-ecs-4.2.0.jar | |
| aliyun-java-sdk-ram-3.0.0.jar | |
| aliyun-java-sdk-sts-3.0.0.jar | |
| aliyun-sdk-oss-3.4.1.jar | |
| animal-sniffer-annotations-1.17.jar |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2020-09-09 20:06:29,276 DEBUG org.apache.hadoop.security.UserGroupInformation: PrivilegedActionException as: <principal> (auth:KERBEROS) | |
| java.io.IOException: Rename unsuccessful : 'hdfs://<cluster>/user/kms/kms.keystore_NEW' to 'hdfs://<cluster>/user/kms/kms.keystore_NEW_ORPHANED_1599649589221' | |
| at org.apache.hadoop.crypto.key.JavaKeyStoreProvider.renameOrFail(JavaKeyStoreProvider.java:644) | |
| at org.apache.hadoop.crypto.key.JavaKeyStoreProvider.flush(JavaKeyStoreProvider.java:541) | |
| at org.apache.hadoop.crypto.key.KeyProviderExtension.flush(KeyProviderExtension.java:127) | |
| at org.apache.hadoop.crypto.key.KeyProviderExtension.flush(KeyProviderExtension.java:127) | |
| at org.apache.hadoop.crypto.key.KeyProviderExtension.flush(KeyProviderExtension.java:127) | |
| at org.apache.hadoop.crypto.key.kms.server.KeyAuthorizationKeyProvider.flush(KeyAuthorizationKeyProvider.java:377) | |
| at org.apache.hadoop.crypto.key.kms.server.KMS$1.run(KMS.java:157) | |
| at org.apache.hadoop.cryp |
aajisaka
/ gist:0697a1a62cfd23a9ce7a473ca145c42c
Created
September 2, 2020 02:52
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2020-08-26 16:50:32,963 INFO org.apache.hadoop.hdfs.server.federation.store.impl.MembershipStoreImpl: NN registration state has changed: <dr01>-><ns01>:nn2:<nn02>-ACTIVE -> <dr02>-><ns01>:nn2:<nn02>-UNAVAILABLE | |
| 2020-08-26 16:50:32,980 WARN org.apache.hadoop.ipc.Client: Exception encountered while connecting to the server | |
| java.net.SocketException: Connection reset | |
| at java.base/java.net.SocketInputStream.read(SocketInputStream.java:186) | |
| at java.base/java.net.SocketInputStream.read(SocketInputStream.java:140) | |
| at java.base/java.io.FilterInputStream.read(FilterInputStream.java:133) | |
| at java.base/java.io.BufferedInputStream.fill(BufferedInputStream.java:252) | |
| at java.base/java.io.BufferedInputStream.read(BufferedInputStream.java:271) | |
| at java.base/java.io.DataInputStream.readInt(DataInputStream.java:392) | |
| at org.apache.hadoop.ipc.Client$IpcStreams.readResponse(Client.java:1881) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ➜ hadoop git:(trunk) mvn clean process-sources javadoc:javadoc-no-fork -pl hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common | |
| [INFO] Scanning for projects... | |
| [WARNING] | |
| [WARNING] Some problems were encountered while building the effective model for org.apache.hadoop:hadoop-yarn-server-resourcemanager:jar:3.4.0-SNAPSHOT | |
| [WARNING] 'build.plugins.plugin.version' for org.jsonschema2pojo:jsonschema2pojo-maven-plugin is missing. @ line 402, column 15 | |
| [WARNING] | |
| [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. | |
| [WARNING] | |
| [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. | |
| [WARNING] |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ➜ hadoop git:(trunk) ✗ mvn process-sources javadoc:javadoc-no-fork -pl hadoop-hdfs-project/hadoop-hdfs-rbf | |
| [INFO] Scanning for projects... | |
| [INFO] ------------------------------------------------------------------------ | |
| [INFO] Detecting the operating system and CPU architecture | |
| [INFO] ------------------------------------------------------------------------ | |
| [INFO] os.detected.name: osx | |
| [INFO] os.detected.arch: x86_64 | |
| [INFO] os.detected.version: 10.15 | |
| [INFO] os.detected.version.major: 10 | |
| [INFO] os.detected.version.minor: 15 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ➜ hadoop git:(trunk) ✗ mvn process-sources javadoc:javadoc-no-fork -pl hadoop-hdfs-project/hadoop-hdfs | |
| [INFO] Scanning for projects... | |
| [INFO] ------------------------------------------------------------------------ | |
| [INFO] Detecting the operating system and CPU architecture | |
| [INFO] ------------------------------------------------------------------------ | |
| [INFO] os.detected.name: osx | |
| [INFO] os.detected.arch: x86_64 | |
| [INFO] os.detected.version: 10.15 | |
| [INFO] os.detected.version.major: 10 | |
| [INFO] os.detected.version.minor: 15 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ➜ hadoop git:(trunk) ✗ mvn process-sources javadoc:javadoc-no-fork -pl hadoop-hdfs-project/hadoop-hdfs-client | |
| [INFO] Scanning for projects... | |
| [INFO] ------------------------------------------------------------------------ | |
| [INFO] Detecting the operating system and CPU architecture | |
| [INFO] ------------------------------------------------------------------------ | |
| [INFO] os.detected.name: osx | |
| [INFO] os.detected.arch: x86_64 | |
| [INFO] os.detected.version: 10.15 | |
| [INFO] os.detected.version.major: 10 | |
| [INFO] os.detected.version.minor: 15 |
NewerOlder