Skip to content

Instantly share code, notes, and snippets.

View kiszk's full-sized avatar
🏠
Working from home

Kazuaki Ishizaki kiszk

🏠
Working from home
View GitHub Profile
@kiszk
kiszk / gist:00ab7d0c69f0e598e383cdc8e72bcc4d
Created December 26, 2016 01:11
Example of seperated APIs for ColumnarVector
CV.java
public abstract class CV implements AutoCloseable {
public int nums() { return 1024; }
public abstract void close();
}
CVrAPI.java
public interface CVrAPI {
public abstract int getInt(int rowId);
}
# build/mvn dependency:tree
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Spark Project Parent POM
[INFO] Spark Project Tags
[INFO] Spark Project Sketch
[INFO] Spark Project Networking
@kiszk
kiszk / gist:402bd8bc45a14be29acb3674ebc4df24
Last active August 17, 2016 06:13
Generated code by Spark compiler in Tungsten
/* 032 */ protected void processNext() throws java.io.IOException {
/* 033 */ while (inputadapter_input.hasNext()) {
/* 034 */ InternalRow inputadapter_row = (InternalRow) inputadapter_input.next();
/* 035 */ int[] inputadapter_value = (int[])inputadapter_row.get(0, null);
/* 036 */
/* 037 */ Object mapelements_obj = ((Expression) references[0]).eval(null);
/* 038 */ scala.Function1 mapelements_value1 = (scala.Function1) mapelements_obj;
/* 039 */
/* 040 */ boolean mapelements_isNull = false || false;
/* 041 */ int[] mapelements_value = null;
@kiszk
kiszk / log4j.properties
Last active May 22, 2023 03:11
How to dump Java source code generated by Catalyst
#spark/sql/core/src/test/resources/log4j.properties
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0