erikdw

Adding 2 nodes to an existing 3-node ZooKeeper ensemble without losing the Quorum

Since many deployments may start out with 3 nodes and so little is known about how to grow a cluster from 3 memebrs to 5 members without losing the existing Quorum, here is an example of how this might be achieved.

In this example, all 5 nodes will be running on the same Vagrant host for the purpose of illustration, running on distinct configurations (ports and data directories) without the actual load of clients.

YMMV. Caveat usufructuarius.

Step 1: Have a healthy 3-node ensemble

erikdw

#!/bin/bash
set -u
set -e -o pipefail

version=${1:-}
# `g++ --version` should reveal that GCC is 4.8.2
gcc_version=`g++ --version`
echo "Building mesos version ${version} using g++ version ${gcc_version}"

# now download and build mesos

erikdw

Tuning Storm+Trident

Tuning a dataflow system is easy:

The First Rule of Dataflow Tuning:
* Ensure each stage is always ready to accept records, and
* Deliver each processed record promptly to its destination

erikdw

// Generated by the protocol buffer compiler.  DO NOT EDIT!
// source: include/mesos/mesos.proto

package org.apache.mesos;

public final class Protos {
  private Protos() {}
  public static void registerAllExtensions(
      com.google.protobuf.ExtensionRegistry registry) {
  }