Skip to content

Instantly share code, notes, and snippets.

View vectorijk's full-sized avatar

Kai Jiang vectorijk

  • Seattle, WA
  • 03:13 (UTC -07:00)
View GitHub Profile
@vectorijk
vectorijk / GSoC.md
Last active August 14, 2018 06:32
GSoC 2018 wrap-up - TPC-H on Apache Beam SQL
@vectorijk
vectorijk / spark-beam-sql.txt
Last active September 23, 2019 09:05
Exceptions Output (Beam SQL on Spark)
Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: Property 'org.apache.beam.sdk.extensions.sql.impl.planner.BeamRelDataTypeSystem' not valid for plugin type org.apache.calcite.rel.type.RelDataTypeSystem
at org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.tools.Frameworks.withPrepare(Frameworks.java:156)
at org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.tools.Frameworks.withPlanner(Frameworks.java:111)
at org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.prepare.PlannerImpl.ready(PlannerImpl.java:145)
at org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.prepare.PlannerImpl.parse(PlannerImpl.java:175)
at org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner.convertToBeamRel(BeamQueryPlanner.java:122)
at org.apache.beam.sdk.extensions.sql.impl.BeamSqlEnv.parseQuery(BeamSqlEnv.java:105)
at org.apache.beam.sdk.extensi
@vectorijk
vectorijk / errors
Created May 15, 2018 14:03
error messgae with running tpc query example
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
Exception in thread "main" java.lang.IllegalStateException: java.lang.UnsupportedOperationException: CROSS JOIN is not supported!
at org.apache.beam.sdk.extensions.sql.QueryTransform.expand(QueryTransform.java:77)
at org.apache.beam.sdk.extensions.sql.QueryTransform.expand(QueryTransform.java:48)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:472)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:160)
at org.apache.beam.sdk.extensions.sql.example.TPCdsSql.main(TPCdsSql.java:316)
@vectorijk
vectorijk / TPCh.java
Last active June 4, 2018 20:57
TPC query example on Beam
/*
* Licensed to the Apache Software Foundation (ASF) under one
* or more contributor license agreements. See the NOTICE file
* distributed with this work for additional information
* regarding copyright ownership. The ASF licenses this file
* to you under the Apache License, Version 2.0 (the
* "License"); you may not use this file except in compliance
* with the License. You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
@vectorijk
vectorijk / Makefile
Created February 2, 2017 12:00
platform9 internship
CC = gcc
THREAD = -pthread
build:
$(CC) $(THREAD) -o client client.c
$(CC) $(THREAD) -o server server.c
clean:
rm client
rm server
t = input()
for kase in range(1, t+1):
n = input()
d = {}
for i in range(n):
raw = raw_input()
si = raw.split()
st = set()
for s in si:
st = st.union(set(s))
@vectorijk
vectorijk / error-message
Created May 15, 2016 08:53
SparkR unit test
Loading required package: methods
Attaching package: ‘SparkR’
The following object is masked from ‘package:testthat’:
describe
The following objects are masked from ‘package:stats’:

Keybase proof

I hereby claim:

  • I am vectorijk on github.
  • I am jiangkai (https://keybase.io/jiangkai) on keybase.
  • I have a public key whose fingerprint is 35C7 6365 E0B8 CF27 E4B5 8D48 203D F7E9 5C3A 2C1C

To claim this, I am signing this object:

@vectorijk
vectorijk / fft.py
Last active December 14, 2015 08:38
fft
#!/usr/bin/env python
import wave
import struct
import sys
import numpy as np
from math import sqrt
import matplotlib
matplotlib.use('Agg')
from matplotlib import pylab
import matplotlib.pyplot as plt
package org.sufficientlysecure.keychain.ui.adapter;
import android.content.Context;
import android.database.ContentObserver;
import android.database.Cursor;
import android.database.DataSetObserver;
import android.os.Handler;
import android.support.v7.widget.RecyclerView;
import android.widget.Filter;
import android.widget.FilterQueryProvider;