Skip to content

Instantly share code, notes, and snippets.

while getopts ":if:" opt; do
case $opt in
echo "Invalid option: -$OPTARG" >&2
exit 1
## temporary installing Strimzi
oc apply -f
# Simple Cluster with one ZK and one Kafka node
oc apply -f

oc get pods -n myproject -w 


View var3.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
willb /
Created Sep 30, 2016
k-means microbenchmark with text-file input
import argparse
from time import clock
from pyspark.sql import SparkSession
from pyspark.mllib.clustering import KMeans
from numpy import fromstring
parser = argparse.ArgumentParser()
parser.add_argument('--master', help='Spark master URL (default: "local[*]")', default="local[*]")
willb /
Created Sep 14, 2016 — forked from masak/
How is git commit sha1 formed

Ok, I geeked out, and this is probably more information than you need. But it completely answers the question. Sorry.

Locally, I'm at this commit:

$ git show
commit d6cd1e2bd19e03a81132a23b2025920577f84e37
Author: jnthn <>
Date:   Sun Apr 15 16:35:03 2012 +0200

    When I added FIRST/NEXT/LAST, it was idiomatic but not quite so fast. This makes it faster. Another little bit of masak++'s program.
View dump.scala
// 'small' was a subsample of meta-full parquet
scala> small.orderBy(small("@timestamp")).map(utils.toJSON).saveAsTextFile("/home/eje/logdemo/logs_ordered.json")
 |-- acl: string (nullable = true)
 |-- acl_action: string (nullable = true)
 |-- acl_status: string (nullable = true)
 |-- action: string (nullable = true)
 |-- after: string (nullable = true)
 |-- agent: string (nullable = true)
 |-- arch: string (nullable = true)
 |-- assignee: struct (nullable = true)
 |    |-- gravatar_id: string (nullable = true)
willb /
Created Sep 10, 2014
How to allow Twitter or emailed feedback from Octopress posts

post.html goes in source/_layouts/post.html and feedback.html goes in source/_includes/post/feedback.html

/* stream-lib Bloom filter interface */
public class extends {
static<> serializer_;
public static<> serializer();
public, int);
public, double);, java.util.BitSet);
public void clear();
public int buckets();
java.util.BitSet filter();
View gist:7570551
[debug] Parsed configuration: LaunchConfiguration(2.10.3,IvyOptions(Some(/home/wibenton/rpmbuild/BUILD/sbt-0.13.1-RC3/ivy-local),Classifiers(List(),List()),List(Ivy(local,file:ivy-local,[organization]/[module]/[revision]/ivy.xml,[organization]/[module]/[revision]/[artifact]-[revision].[ext],false,false,false,false)),List(sha1, md5),true),Application(org.scala-sbt,sbt,sbt.version[0.13.1-RC3],sbt.xMain,List(xsbti, extra),Disabled,[;@5638680),BootSetup(/home/wibenton/rpmbuild/BUILD/sbt-0.13.1-RC3/sbt-boot-dir,true,/home/wibenton/rpmbuild/BUILD/sbt-0.13.1-RC3/project/,Search(none,List()),,false,false),xsbt.boot.Logging@49134043,List())
[debug] Resolved configuration: LaunchConfiguration(2.10.3,IvyOptions(Some(/home/wibenton/rpmbuild/BUILD/sbt-0.13.1-RC3/ivy-local),Classifiers(List(),List()),List(Ivy(local,file:ivy-local,[organization]/[module]/[revision]/ivy.xml,[organization]/[module]/[revision]/[artifact]-[revision].[ext],false,false,false,false)),List(sha1, md5),true),Application(o