arrawatia

1. General Background and Overview

• Probabilistic Data Structures for Web Analytics and Data Mining : A great overview of the space of probabilistic data structures and how they are used in approximation algorithm implementation.
• Models and Issues in Data Stream Systems
• Philippe Flajolet’s contribution to streaming algorithms : A presentation by Jérémie Lumbroso that visits some of the hostorical perspectives and how it all began with Flajolet
• Approximate Frequency Counts over Data Streams by Gurmeet Singh Manku & Rajeev Motwani : One of the early papers on the subject.
• [Methods for Finding Frequent Items in Data Streams](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.187.9800&rep

arrawatia

// Use Gists to store code you would like to remember later on
console.log(window); // log the "window" object to the console

arrawatia

Internet Scale Services Checklist

A checklist for designing and developing internet scale services, inspired by James Hamilton's 2007 paper "On Desgining and Deploying Internet-Scale Services."

• http://mvdirona.com/jrh/talksandpapers/jamesrh_lisa.pdf

Basic tenets

• Does the design expect failures to happen regularly and handle them gracefully?
• Have we kept things as simple as possible?

arrawatia

#!/bin/bash
cd /tmp && \
mkdir emacs-src && cd emacs-src && \
wget http://mirror.team-cymru.org/gnu/emacs/emacs-24.4.tar.gz && \
tar xvf emacs-24.4.tar.gz && \
sudo apt-get -yy install build-essential && \
sudo apt-get -yy build-dep emacs24 && \
cd emacs-24.4 && \
./configure && \
make && \

arrawatia

[~/code/src/java-scripting-experiments/src/main/resources (master *=) ]➔ kafkacat -P -X list -b fb-log-0.demo-us-east-1b.quantezza.com -t test
## Global configuration properties

Property                                 | C/P |       Default | Description
-----------------------------------------|-----|--------------:|--------------------------
client.id                                |  *  |       rdkafka | Client identifier.
metadata.broker.list                     |  *  |               | Initial list of brokers. The application may also use `rd_kafka_brokers_add()` to add brokers during runtime.
message.max.bytes                        |  *  |       4000000 | Maximum transmit message size.
receive.message.max.bytes                |  *  |     100000000 | Maximum receive message size. This is a safety precaution to avoid memory exhaustion in case of protocol hickups. The value should be at least fetch.message.max.bytes * number of partitions consumed from + messaging overhead (e.g. 200000 bytes).
metadata.re

arrawatia

#!/bin/sh

# Alot of these configs have been taken from the various places
# on the web, most from here
# https://github.com/mathiasbynens/dotfiles/blob/master/.osx

# Set the colours you can use
black='\033[0;30m'
white='\033[0;37m'
red='\033[0;31m'

arrawatia

{transfer-Q|wordCounter-1-1372013468|259be866-478a-46c4-9479-9ab71b748e59|2198f4ae-89cf-48e9-9e1b-7b7db420de16|4}-created. Buffer size : 1024
transfer-Q
{executor-receive-Q|wordCounter-1-1372013468|[2 2]}-created. Buffer size : 1024
executor-receive-Q
{executor-receive-Q|wordCounter-1-1372013468|[3 3]}-created. Buffer size : 1024
executor-receive-Q
{executor-receive-Q|wordCounter-1-1372013468|[4 4]}-created. Buffer size : 1024
executor-receive-Q
{executor-receive-Q|wordCounter-1-1372013468|[5 5]}-created. Buffer size : 1024
executor-receive-Q