Skip to content

Instantly share code, notes, and snippets.

View electrum's full-sized avatar
🚀
Working on @trinodb at @starburstdata

David Phillips electrum

🚀
Working on @trinodb at @starburstdata
View GitHub Profile
@electrum
electrum / gist:1142719
Created August 12, 2011 19:03
galaxy coordinator config
coordinator.local-maven-repo.enabled=true
coordinator.git-config-repo.uri=/home/ubuntu/config.git
coordinator.status.expiration=5s
http-server.http.port=64000
node.environment=demo
@electrum
electrum / gist:1169220
Created August 24, 2011 20:59
install hadoop-snappy
cd hadoop-snappy
# Mac OS X
tar xzvf ~/Downloads/snappy-1.0.3.tar.gz
cd snappy-1.0.3
./configure --prefix=$(greadlink -m $PWD/../snappy) && make install
cd ..
# Linux
wget http://snappy.googlecode.com/files/snappy-1.0.3.tar.gz
package javatest;
import com.google.common.base.Charsets;
import com.google.common.collect.Lists;
import com.google.common.io.Files;
import com.proofpoint.json.JsonCodec;
import org.apache.commons.httpclient.Header;
import org.apache.commons.logging.LogFactory;
import org.apache.log4j.BasicConfigurator;
import org.apache.log4j.Level;
@electrum
electrum / bench-assert.txt
Created September 2, 2011 18:32
snappy-1.0.3 benchmarks
Running microbenchmarks.
WARNING: Compiled with assertions enabled, will be slow.
Benchmark Time(ns) CPU(ns) Iterations
---------------------------------------------------
BM_UFlat/0 66408 66404 2856 1.4GB/s html
BM_UFlat/1 715414 715374 270 936.0MB/s urls
BM_UFlat/2 6901 6901 28368 17.1GB/s jpg
BM_UFlat/3 23015 23014 8071 3.8GB/s pdf
BM_UFlat/4 270188 270209 710 1.4GB/s html4
BM_UFlat/5 25094 25089 7388 935.2MB/s cp
@electrum
electrum / part-handler.py
Created September 3, 2011 01:31
Part Handler for CloudInit to write config files
#part-handler
def list_types():
return ["text/plain"]
def handle_part(data, ctype, filename, payload):
if ctype not in ("__begin__", "__end__"):
import os
basedir = "/home/ubuntu/cloudconf"
try:
@electrum
electrum / gist:1214565
Created September 13, 2011 18:18
Read Apple Mail .emlx file
private static String readEmlx(InputStream in) throws IOException
{
BufferedReader reader = new BufferedReader(new InputStreamReader(in, Charsets.UTF_8));
int size = Integer.valueOf(reader.readLine().trim());
if (size <= 0) {
throw new IllegalStateException("bad size: " + size);
}
char[] buf = new char[size];
int n = reader.read(buf, 0, size);
if (n < size) {
@electrum
electrum / CaseInsensitiveKeyDeserializers.java
Created October 3, 2011 22:59
Case insensitive key deserialization for Jackson
import org.codehaus.jackson.map.BeanDescription;
import org.codehaus.jackson.map.BeanProperty;
import org.codehaus.jackson.map.DeserializationConfig;
import org.codehaus.jackson.map.DeserializationContext;
import org.codehaus.jackson.map.JsonMappingException;
import org.codehaus.jackson.map.KeyDeserializer;
import org.codehaus.jackson.map.KeyDeserializers;
import org.codehaus.jackson.type.JavaType;
import java.io.IOException;
@electrum
electrum / Makefile
Created January 31, 2012 17:52
ttysize
all: ttysize
clean:
rm -f ttysize
ttysize: ttysize.c
gcc -Wall -Werror -o $@ $<
@electrum
electrum / IAMCredentials.java
Created February 3, 2012 19:54
AWS IAM Credential Creation
package javatest;
import com.amazonaws.auth.BasicAWSCredentials;
import com.amazonaws.services.identitymanagement.AmazonIdentityManagementClient;
import com.amazonaws.services.identitymanagement.model.AccessKey;
import com.amazonaws.services.identitymanagement.model.CreateAccessKeyRequest;
import com.amazonaws.services.identitymanagement.model.CreateUserRequest;
import com.amazonaws.services.identitymanagement.model.DeleteAccessKeyRequest;
import com.amazonaws.services.identitymanagement.model.DeleteUserPolicyRequest;
import com.amazonaws.services.identitymanagement.model.DeleteUserRequest;
@electrum
electrum / AbstractParam.java
Created March 9, 2012 18:25
Jersey AbstractParam
package com.proofpoint.anomalytics.mailfetcher;
import javax.ws.rs.WebApplicationException;
import javax.ws.rs.core.Response;
import static javax.ws.rs.core.Response.Status;
/**
* Abstract parameter class for Jersey parameters
*