| #cribbed from http://vimeo.com/52569901 (Twilio carrier call origination moderation) | |
| # The idea is that many fan-in queues can enqueue at any rate, but | |
| # dequeue needs to happen in a rate-controlled manner without allowing | |
| # any individual input queue to starve other queues. | |
| # http://en.wikipedia.org/wiki/Leaky_bucket (second sense, "This version is referred to here as the leaky bucket as a queue.") | |
| # | |
| # requires: | |
| # redis 2.6+ | |
| # redis-py>=2.7.0 | |
| # anyjson |
| <!DOCTYPE html> | |
| <html> | |
| <head><title>ChamberedTest</title></head> | |
| <script type="text/javascript" src="js/chambered.js"></script> | |
| <style type="text/css"> | |
| canvas, img { | |
| image-rendering: optimizeSpeed; | |
| image-rendering: -moz-crisp-edges; | |
| image-rendering: -webkit-optimize-contrast; |
| #!/usr/bin/env python | |
| # -*- coding: utf-8 -*- | |
| # | |
| # Video of this screencast: https://vimeo.com/57296525 | |
| # | |
| # | |
| from __future__ import print_function, division, absolute_import | |
| from PIL import Image as pImage | |
| import numpy |
| import spark.streaming.StreamingContext._ | |
| import spark.streaming.{Seconds, StreamingContext} | |
| import spark.SparkContext._ | |
| import spark.storage.StorageLevel | |
| import spark.streaming.examples.twitter.TwitterInputDStream | |
| import com.twitter.algebird.HyperLogLog._ | |
| import com.twitter.algebird._ | |
| /** | |
| * Example of using HyperLogLog monoid from Twitter's Algebird together with Spark Streaming's |
| public class Promises { | |
| private static class PageMetrics { | |
| Integer visits; | |
| Long avgMsOnPage; | |
| @Override | |
| public String toString() { | |
| return String.format("{ avgMsOnPage=%d, visits=%d }", avgMsOnPage, visits); | |
| } |
Kafka acts as a kind of write-ahead log (WAL) that records messages to a persistent store (disk) and allows subscribers to read and apply these changes to their own stores in a system appropriate time-frame.
Terminology:
| // Just before switching jobs: | |
| // Add one of these. | |
| // Preferably into the same commit where you do a large merge. | |
| // | |
| // This started as a tweet with a joke of "C++ pro-tip: #define private public", | |
| // and then it quickly escalated into more and more evil suggestions. | |
| // I've tried to capture interesting suggestions here. | |
| // | |
| // Contributors: @r2d2rigo, @joeldevahl, @msinilo, @_Humus_, | |
| // @YuriyODonnell, @rygorous, @cmuratori, @mike_acton, @grumpygiant, |
| #!/usr/bin/env python | |
| # -*- mode: python, coding: utf-8 -*- | |
| # | |
| # This incredible piece of code makes git a bit Polish, a bit Western Ukrainian, | |
| # пше прошу пана | |
| # Joke is based on fact that 'git' is 'пше' in qwerty/йцукен layouts | |
| # | |
| # (c) 2013 Alexander Solovyov under terms of WTFPL | |
| import sys |
| object twitter { | |
| import play.api.libs.ws._ | |
| import play.api.libs.iteratee._ | |
| import play.api.libs.oauth._ | |
| import scala.concurrent.ExecutionContext.Implicits.global | |
| val key = ConsumerKey("XXXX", "XXXX") | |
| val twitter = OAuth(ServiceInfo( | |
| "https://api.twitter.com/oauth/request_token", |
| (ns my-test-ns | |
| (:require [clojure.test :refer :all]) | |
| (:import [java.util.concurrent CountDownLatch TimeUnit]) | |
| (defmacro with-latch | |
| [countdown-from & body] | |
| `(let [latch# (CountDownLatch. ~countdown-from) | |
| ~'latch latch#] | |
| ~@body | |
| (.await latch# 5 TimeUnit/SECONDS) |
