Sadayuki Furuhashi frsyuki
frsyuki
/ figure1.png
Last active
August 29, 2015 13:56
frsyuki
/ DeserBenchmark.java
Last active
August 29, 2015 14:00
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import java.util.Random; | |
| import sun.misc.Unsafe; | |
| import sun.nio.ch.DirectBuffer; | |
| import java.lang.reflect.Field; | |
| import java.nio.ByteBuffer; | |
| import java.io.File; | |
| import java.io.FileOutputStream; | |
| import java.io.IOException; |
frsyuki
/ msgpack-v07-unpacker-design-doc.java
Created
May 4, 2014 03:54
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| public interface XyzInput { | |
| public Buffer getNextBuffer() throws IOException; | |
| } | |
| // non-reference counter | |
| public abstract class Buffer { | |
| private Unsafe unsafe; | |
| private long pointer; | |
| private Object base; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import java.util.Random; | |
| import sun.misc.Unsafe; | |
| import sun.nio.ch.DirectBuffer; | |
| import java.lang.reflect.Field; | |
| import java.nio.ByteBuffer; | |
| import java.io.File; | |
| import java.io.FileOutputStream; | |
| import java.io.IOException; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| all: run | |
| MSGPACK_06_JAR = msgpack-java-0.6.11.jar | |
| $(MSGPACK_06_JAR): | |
| curl "http://search.maven.org/remotecontent?filepath=org/msgpack/msgpack/0.6.11/msgpack-0.6.11.jar" -o $@ | |
| JAVASSIST_JAR = javassist-3.18.2-GA.jar | |
| $(JAVASSIST_JAR): | |
| curl "http://search.maven.org/remotecontent?filepath=org/javassist/javassist/3.18.2-GA/javassist-3.18.2-GA.jar" -o $@ |
frsyuki
/ presto-1441.md
Last active
August 29, 2015 14:03
frsyuki
/ gist:e73c89db36c2069a7589
Created
July 15, 2014 06:23
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Add workaround for a deadlock issue of Class.getAnnotation() (JDK-7122142) | |
| diff --git a/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java b/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java | |
| index a80feb9..c92b4f6 100644 | |
| --- a/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java | |
| +++ b/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java | |
| @@ -1613,16 +1613,20 @@ public static boolean isDeterministic(GenericUDF genericUDF) { | |
| // the deterministic annotation declares | |
| return false; | |
| } |
frsyuki
/ gist:12271f0fe2b02535202d
Created
July 16, 2014 06:15
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| "main" prio=10 tid=0x00007f0fd800e800 nid=0x934a runnable [0x00007f0fdec8f000] | |
| java.lang.Thread.State: RUNNABLE | |
| at java.lang.Class.initAnnotationsIfNecessary(Class.java:3067) | |
| - locked <0x000000009e5c7f70> (a java.lang.Class for org.apache.hadoop.hive.ql.udf.generic.GenericUDFBridge) | |
| at java.lang.Class.getAnnotation(Class.java:3029) | |
| at org.apache.hadoop.hive.ql.exec.FunctionRegistry.isStateful(FunctionRegistry.java:1186) | |
| at org.apache.hadoop.hive.ql.exec.FunctionRegistry.isDeterministic(FunctionRegistry.java:1161) | |
| at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.isDeterministic(ExprNodeGenericFuncEvaluator.java:143) | |
| at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.evaluate(ExprNodeGenericFuncEvaluator.java:153) | |
| at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator$DeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:64) |
frsyuki
/ java-socketread0-hang-bug.txt
Created
July 25, 2014 01:38
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Reading data from a socket hangs for at least 1 hour even if I set Socket.setSoTimeout to non-0 value. It happens very rarely (once a month under 100 or more connections in parallel with continuously 10MB/s or more data transfer). | |
| Although it rarely happens, it leads significant impact to applications if it happens. | |
| When it hanged, thread dump includes following stack trace: | |
| ---- | |
| "pool-3-thread-6" prio=10 tid=0x00007fd43006e800 nid=0xdf23 runnable [0x00007fd424e56000] | |
| java.lang.Thread.State: RUNNABLE | |
| at java.net.SocketInputStream.socketRead0(Native Method) |
frsyuki
/ ruby-struct-init.rb
Last active
August 29, 2015 14:04
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| require 'benchmark' | |
| LOOP = 500000 | |
| NKEYS = 20 | |
| vals = (0..NKEYS).map {|i| "val#{i}" } | |
| keys = (0..NKEYS).map {|i| "col#{i}" } | |
| S = Struct.new(*keys.map {|k| k.to_sym }) |
OlderNewer