Skip to content

Instantly share code, notes, and snippets.

View jey's full-sized avatar

Jey Kottalam jey

  • Taste Institute
  • Berkeley, California
View GitHub Profile

Keybase proof

I hereby claim:

  • I am jey on github.
  • I am jeyjey (https://keybase.io/jeyjey) on keybase.
  • I have a public key ASDS3ODR9hhPSOGG2yqCuQJUP5y_QzopiwA9DXQTpbsxuwo

To claim this, I am signing this object:

docker run --rm --name risecamp_ray --user root --memory 16g --shm-size 16g --network=ray_network -p 127.0.0.1:8080:8080 -v /var/run/docker.sock:/var/run/docker.sock -e NOTEBOOK_FLAGS= --NotebookApp.password='sha1:3ec466c1b38d:6b4670be0553e483ca5ddde58bb4765c8ab40c10' --NotebookApp.allow_origin='*' -e CONTAINER_BASE_URL=camp/ray -p 127.0.0.1:3000:3000 -p 127.0.0.1:6006:6006 -p 127.0.0.1:8889:8889 ucbrise/risecamp2018-ray:latest
$ build/mvn integration-test -pl resource-managers/kubernetes/integration-tests -am -DzincPort=3662 -Phadoop-2.7 -Pkubernetes -Pkinesis-asl -Phive -Phive-thriftserver -DskipTests -Dspark.kubernetes.test.sparkTgz=$PWD/spark-2.4.0-SNAPSHOT-bin-20180717-40c0269.tgz 2>&1 | tee test2.log
Using `mvn` from path: /usr/bin/mvn
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Spark Project Parent POM
[INFO] Spark Project Tags
[INFO] Spark Project Local DB
Using `mvn` from path: /usr/bin/mvn
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Spark Project Parent POM
[INFO] Spark Project Tags
[INFO] Spark Project Local DB
[INFO] Spark Project Networking
[INFO] Spark Project Shuffle Streaming Service
@jey
jey / DFSInputStream.java
Created July 4, 2013 22:03
DFSInputStream.java from CDH 4.3.0
/**
* Licensed to the Apache Software Foundation (ASF) under one
* or more contributor license agreements. See the NOTICE file
* distributed with this work for additional information
* regarding copyright ownership. The ASF licenses this file
* to you under the Apache License, Version 2.0 (the
* "License"); you may not use this file except in compliance
* with the License. You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
diff --git a/pom.xml b/pom.xml
index 721f92e..17aedf4 100644
--- a/pom.xml
+++ b/pom.xml
@@ -18,7 +18,7 @@
<encoding>UTF-8</encoding>
<scala.version>2.9.2</scala.version>
<hive.version>0.9.0-amplab-4</hive.version>
- <spark.version>0.7.0-SNAPSHOT</spark.version>
+ <spark.version>0.7.0</spark.version>
@jey
jey / 0-example.cpp
Last active December 12, 2015 12:49
Eigen + NumPy example
#define SKIP_NO_IMPORT
#include "common.hpp"
#include <iostream>
namespace libtheta {
PyObjectRef moments_from_samples(const PyObjectRef &self, const PyObjectRef &args)
{
PyArrayObject *weights_ = NULL;
PyArrayObject *samples_ = NULL;
@jey
jey / log
Created February 8, 2013 19:21
+ echo 'Running translated...'
Running translated...
+ ../topaz/bin/topaz -v ../mspec/bin/mspec-run core/array/plus_spec.rb
topaz (ruby-1.9.3p125) [x86_64-linux]
PyPy assertion failed at topaz_objects_intobject.c:655:
in pypy_g_W_FixnumObject_method_left_shift: The shift count is outside of the supported range
RPython traceback:
File "topaz_frame.c", line 583, in Frame_popitemsreverse
File "rpython_rtyper_rrange.c", line 75, in ll_rangenext_down__rangePtr_Signed
tester.sh: line 2: 17556 Aborted ../topaz/bin/topaz -v ../mspec/bin/mspec-run core/array/plus_spec.rb
// compile in C++11 mode
#include <Eigen/Dense>
using namespace Eigen;
typedef Matrix<double, Dynamic, Dynamic, RowMajor> RowMajorMatrix;
typedef Matrix<double, Dynamic, Dynamic, ColMajor> ColMajorMatrix;
int main()
{
unsigned p = 50000;
@jey
jey / Makefile
Created October 23, 2012 01:19
segfaulting python extension module
crash: mytest.so
python -c "import mytest; import numpy; mytest.foo(numpy.array([123.0]))"
mytest.so: test1.c test2.c
$(CC) -fPIC -shared `python-config --cflags` -o $@ $^ `python-config --ldflags`