abacaphiliac

#!/usr/bin/env bash

brew update

brew tap caskroom/cask
brew tap homebrew/homebrew-php

brew cask install java

brew install awscli

abacaphiliac

1. AWS Aurora to Maxwell STDOUT Producer
2. AWS Aurora to Maxwell Kafka Producer
3. AWS Aurora to Maxwell Namespaced Topic Kafka Producer
4. AWS Aurora to Maxwell Kinesis Producer

abacaphiliac

Prerequisites

1. AWS Aurora to Maxwell STDOUT Producer
2. Run Kafka Container
3. Create an AWS Kinesis Stream
4. Configuring the AWS Command Line Interface

After running through the prerequisites, you will have:

• a Maxwell image named osheroff/maxwell
• an AWS Aurora instance
• a Kafka service named kafka, listening on kafka:9092

abacaphiliac

Prerequisites

1. AWS Aurora to Maxwell Kafka Producer

After running through the prerequisites, you will have:

• an AWS Aurora instance
• a Maxwell image named osheroff/maxwell
• a Kafka service named kafka, listening on kafka:9092

Start Maxwell with Namespaced Topic Kafka Producer

This is a slight variation of the prerequisite, AWS Aurora to Maxwell Kafka Producer.

abacaphiliac

Prerequisites

1. AWS Aurora to Maxwell STDOUT Producer
2. Run Kafka Container

After running through the prerequisites, you will have:

• an AWS Aurora instance
• a Maxwell image named osheroff/maxwell
• a Kafka service named kafka, listening on kafka:9092

Start Maxwell with Kafka Producer

abacaphiliac

Start Kafka service

The following commands will start a container with Kafka and Zookeeper running on mapped ports 2181 (Zookeeper) and 9092 (Kafka).

docker pull spotify/kafka
docker run -d -p 2181:2181 -p 9092:9092 --env ADVERTISED_HOST=kafka --env ADVERTISED_PORT=9092 --name kafka spotify/kafka

Why Spotify?

ADVERTISTED_HOST was set to kafka, which will allow other containers to be able to run Producers and Consumers.

abacaphiliac

Prerequisites

1. docker pull osheroff/maxwell

After running through the prerequisites, you will have:

• a Maxwell image named osheroff/maxwell

AWS Aurora

1. Create an Aurora instance: Creating an Amazon Aurora DB Cluster
2. Create a DB Cluster Parameter Group: Creating a DB Parameter Group
3. Activate the binlog in your DB Cluster Parameter Group: Binary Logging Format

abacaphiliac

Verifying that +abacaphiliac is my blockchain ID. https://onename.com/abacaphiliac