Distributed Systems Reading List

dist_sys_reading.md

Distributed Systems/Streaming Reading List

• Chris Meiklejohn's Dist Systems reading list

• The Log: What every software engineer should know about real-time data's unifying abstraction

• Messaging Architecture: Using RabbitMQ at the World’s 8th Largest Retailer

• The 8 Requirements of Real-Time Stream Processing

• In Search of am Understandable Consensus Algorithm (Raft)

• A simple totally ordered broadcast protocol

• STREAM PROCESSING, EVENT SOURCING, REACTIVE, CEP… AND MAKING SENSE OF IT ALL

• Vector Clocks are Easy

• Vector Clocks are Hard

• Epidemic Broadcast Trees (aka: Plumtree)

• Your server as a function

  • Twitter Finagle, Futures, Scala

• A Comprehensive study of Convergent and Commutative Replicated Data Types

• Incremental Stream Processing using Computational Conflict-free Replicated Data Types

• High-Availability Algorithms for Distributed Stream Processing

• Zab: High-performance broadcast for primary-backup systems

• Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing

• Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center

• Datacenter Computing with Apache Mesos

• Efficient data transfer through zero copy

Apache Storm

• How Spotify Scales Apache Storm

• Lots of great Storm blog posts

• Apache Storm 0.9 Training Deck and Tutorial

• Apache Kafka 0.8 Training Deck and Tutorial

• Understanding the Internal Message Buffers of Storm

• Understanding the Parallelism of a Storm Topology

• Implementing Real-Time Trending Topics With a Distributed Rolling Count Algorithm in Storm

• Scalable real time state update with Storm groupBy/persistentAggregate/IBackingMap

• Integrating Kafka and Spark Streaming: Code Examples and State of the Game

• Storm vs. Spark Streaming: Side-by-side comparison

Tools

• Apache Kafka

• Apache Zookeeper

• Apache BookKeeper

• Apache SAMOA- Scalable Advanced Massive Online Analysis

• ZooKeeper vs. Doozer vs. Etcd

• LinkedIn Samza

• Wolf: a platform for trading on foreign exchange market

• riak_dt: CRDT's for the Riak distributed database

  • most of the CRDT's are implemented and QuickChecked.

• StreamFlow