Skip to content

Instantly share code, notes, and snippets.

View aajisaka's full-sized avatar

Akira Ajisaka aajisaka

247 followers · 48 following
View GitHub Profile
@aajisaka
aajisaka / THIRD-PARTY.txt.branch-2.8
Created April 25, 2016 14:15
(branch-2.8) $ mvn license:aggregate-add-third-party
Lists of 245 third-party dependencies.
(BSD License) AntLR Parser Generator (antlr:antlr:2.7.7 - http://www.antlr.org/)
(Public Domain) AOP alliance (aopalliance:aopalliance:1.0 - http://aopalliance.sourceforge.net)
(BSD) ASM Core (asm:asm:3.2 - http://asm.objectweb.org/asm/)
(Unknown license) bcprov-jdk15 (bouncycastle:bcprov-jdk15:140 - no url defined)
(ASF 2.0) Code Generation Library (cglib:cglib:2.2 - http://cglib.sourceforge.net/)
(Eclipse Public License - v 1.0) (GNU Lesser General Public License) Logback Classic Module (ch.qos.logback:logback-classic:1.1.2 - http://logback.qos.ch)
(Eclipse Public License - v 1.0) (GNU Lesser General Public License) Logback Core Module (ch.qos.logback:logback-core:1.1.2 - http://logback.qos.ch)
(Apache License, Version 2.0) AWS SDK for Java - Core (com.amazonaws:aws-java-sdk-core:1.10.6 - https://aws.amazon.com/sdkforjava)
@aajisaka
aajisaka / THIRD-PARTY.txt.branch-2.7
Created April 25, 2016 14:22
(branch-2.7) $ mvn license:aggregate-add-third-party
Lists of 214 third-party dependencies.
(BSD License) AntLR Parser Generator (antlr:antlr:2.7.7 - http://www.antlr.org/)
(Public Domain) AOP alliance (aopalliance:aopalliance:1.0 - http://aopalliance.sourceforge.net)
(BSD) ASM Core (asm:asm:3.2 - http://asm.objectweb.org/asm/)
(Unknown license) bcprov-jdk15 (bouncycastle:bcprov-jdk15:140 - no url defined)
(ASF 2.0) Code Generation Library (cglib:cglib:2.2 - http://cglib.sourceforge.net/)
(Apache License, Version 2.0) AWS SDK for Java (com.amazonaws:aws-java-sdk:1.7.4 - https://aws.amazon.com/sdkforjava)
(Apache License 2.0) Metrics Core (com.codahale.metrics:metrics-core:3.0.1 - http://metrics.codahale.com/metrics-core/)
(GNU Lesser General Public License, Version 2.1) (The Apache Software License, Version 2.0) Jackson-annotations (com.fasterxml.jackson.core:jackson-annotations:2.2.3 - http://wiki.fasterxml.com/JacksonHome)
@aajisaka
aajisaka / THIRD-PARTY.txt.branch-2.6
Created April 25, 2016 14:43
(branch-2.6) $ mvn license:aggregate-add-third-party
Lists of 212 third-party dependencies.
(BSD License) AntLR Parser Generator (antlr:antlr:2.7.7 - http://www.antlr.org/)
(Public Domain) AOP alliance (aopalliance:aopalliance:1.0 - http://aopalliance.sourceforge.net)
(BSD) ASM Core (asm:asm:3.2 - http://asm.objectweb.org/asm/)
(Unknown license) bcprov-jdk15 (bouncycastle:bcprov-jdk15:140 - no url defined)
(ASF 2.0) Code Generation Library (cglib:cglib:2.2 - http://cglib.sourceforge.net/)
(Apache License, Version 2.0) AWS SDK for Java (com.amazonaws:aws-java-sdk:1.7.4 - https://aws.amazon.com/sdkforjava)
(Apache License 2.0) Metrics Core (com.codahale.metrics:metrics-core:3.0.1 - http://metrics.codahale.com/metrics-core/)
(GNU Lesser General Public License, Version 2.1) (The Apache Software License, Version 2.0) Jackson-annotations (com.fasterxml.jackson.core:jackson-annotations:2.2.3 - http://wiki.fasterxml.com/JacksonHome)
@aajisaka
aajisaka / Benchmark.md
Created April 26, 2016 13:40
Benchmark MAPREDUCE-2841

Native off: 506sec

$ hadoop jar hadoop-mapreduce-examples-3.0.0-SNAPSHOT.jar wordcount -Dmapreduce.job.reduces=10 wikimedia out1
(snip)
16/04/26 12:43:26 INFO mapreduce.Job: Counters: 50
	File System Counters
		FILE: Number of bytes read=32688875608
		FILE: Number of bytes written=46793855889
		FILE: Number of read operations=0
@aajisaka
aajisaka / updateHadoop.sh
Last active May 23, 2016 21:14
Shell script used for updating hadoop (trunk) in my development VM
#!/bin/sh
if [ $# -ne 1 ]; then
echo "Usage ./updateHadoop.sh <NAME>"
echo "New hadoop package will be installed into /usr/hadoop/NAME"
echo "We recommend to use <YYYYMMDD-ISSUEID> for NAME."
exit 1
fi
# New hadoop package is installed to /usr/local/NAME
NAME=$1
@aajisaka
aajisaka / ratings.csv
Created September 29, 2016 07:54
1 3.5
1 4.0
1 5.9
1 8.7
2 9.3
2 9.6
2 10.3
1 10.2
2 3.8
3 11.5
@aajisaka
aajisaka / hadoop-bundled-jars.txt
Last active November 4, 2016 19:36
find . -name "*.jar" | xargs -n1 basename | sort | uniq | grep -v 3.0.0-alpha1
ST4-4.0.7.jar
aliyun-sdk-oss-2.2.1.jar
annotations-api.jar
antlr-2.7.7.jar
antlr-3.5.jar
antlr-runtime-3.5.jar
aopalliance-1.0.jar
asm-all-5.0.2.jar
avro-1.7.4.jar
aws-java-sdk-core-1.10.6.jar
@aajisaka
aajisaka / Test.java
Created December 1, 2016 13:41
JDK-9045797 reproduce
import java.io.File;
import java.io.FileWriter;
import java.nio.file.Files;
import java.nio.file.Path;
import java.nio.file.attribute.BasicFileAttributeView;
import java.nio.file.attribute.FileTime;
public class Test {
public static void main(String args[]) throws Exception {
// create a non-empty file.
@aajisaka
aajisaka / qbt.log
Created December 5, 2016 07:14
qbt log
/tmp/yetus-4429.25592 has been created
Modes: UnitTests
============================================================================
============================================================================
Confirming git environment
============================================================================
============================================================================
@aajisaka
aajisaka / log
Created July 19, 2017 05:02
$ mvn clean install -DskipTests -DskipShade -Dzookeeper.version=3.5.3-beta 2>&1 > log
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hadoop:hadoop-dist:jar:3.0.0-beta1-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-gpg-plugin is missing. @ line 133, column 15
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO] ------------------------------------------------------------------------