Skip to content

Instantly share code, notes, and snippets.

View skucukbay's full-sized avatar

Serkan skucukbay

View GitHub Profile
@skucukbay
skucukbay / ZookeeperNodeAdRemove.md
Last active September 28, 2023 07:54
Adding/Removing nodes from existing Zookeeper cluster

Problem

Adding 3 new nodes to cluster and removing existing 2 nodes, in final state we will have 3 nodes in cluster.

I need to change the location of Zookeeper nodes in production without losing the Quorum. To provide this requirement, i decided to follow steps below

  • Download zookeeper (easy:)
  • Configure new nodes to cluster as new follower
  • Install Supervisord supervisord to give control of process to it.
  • Run new nodes via supervisord
  • Then restart existing follower

Tuning Storm+Trident

Tuning a dataflow system is easy:

The First Rule of Dataflow Tuning:
* Ensure each stage is always ready to accept records, and
* Deliver each processed record promptly to its destination

Tuning Storm+Trident

Tuning a dataflow system is easy:

The First Rule of Dataflow Tuning:
* Ensure each stage is always ready to accept records, and
* Deliver each processed record promptly to its destination