Start Zookeeper
bin/zookeeper-server-start.sh config/zookeeper.properties
Start Kafka
bin/kafka-server-start.sh config/server.properties
// cluster http call to json | |
http://<url>:2113/gossip?format=json |
// Install tfenv | |
homebrew install tfenv | |
//Browse Terraform versions | |
$ tfenv list-remote | |
0.12.0 | |
0.12.0-rc1 | |
0.12.0-beta2 | |
0.12.0-beta1 |
#sample secret yaml with plain text stringData mechanism | |
apiVersion: v1 | |
stringData: | |
someCredentialName: someSuperSecretCredential | |
kind: Secret | |
metadata: | |
name: someSecretName | |
namespace: someNamespace | |
type: Opaque |
//Install redis cli for connectivity testing from containers | |
apt-get update | |
apt-get install redis-tools | |
//Ping test | |
redis-cli -c -h redis-cluster-name.xxxxxx.clustercfg.use1.cache.amazonaws.com -p 6379 ping | |
//Monitor incoming writes | |
redis-cli -c -h redis-cluster-name.xxxxxxxxxxx.clustercfg.use1.cache.amazonaws.com -p 6379 monitor |
////Install and connect to PostgreSQL via CLI//// | |
//Install the psql cli tool | |
yum install psql | |
//Then connect via the utility with the following flags | |
psql \ | |
--host=some-path.cluster-abcdefghijklmnop.us-east-1.rds.amazonaws.com \ | |
--port=5432 \ | |
--username=your_username \ |
// Find your hostname and IP | |
hostname -i //ip | |
hostname -f //long host name (FQDN) | |
TODO: | |
netstat | |
ifconfig | |
dig |
kubectl create namespace <mynamespace> | |
kubectl get namespaces | |
kubectl get pods | |
kubectl config view | |
kubectl cluster-info dump | |
#exec into a shell within a running pod | |
kubectl exec -it <pod_name> -n <namespace> -- /bin/bash |
//Find EC2 Instnaces by AMI | |
aws ec2 describe-instances --query 'Reservations[*].Instances[*].[Placement.AvailabilityZone, State.Name, ImageId, InstanceId]' --filters "Name=image-id, Values=ami-xxxxxx" --output=text | |
//// Find EC2 Instances by tag //// | |
//Instnaces missing the `name` tag | |
aws ec2 describe-instances \ | |
--output text \ | |
--query 'Reservations[].Instances[?!not_null(Tags[?Key == `Name`].Value)] | [].[InstanceId]' |
Start Zookeeper
bin/zookeeper-server-start.sh config/zookeeper.properties
Start Kafka
bin/kafka-server-start.sh config/server.properties
Apache Kafka is a highly-scalable publish-subscribe messaging system that can serve as the data backbone in distributed applications. With Kafka’s Producer-Consumer model it becomes easy to implement multiple data consumers that do live monitoring as well persistent data storage for later analysis. You can assume that RabbitMQ is similar to Kafka, You do get an option for message-sending or Broadcasting. The installation process for OSX is as below.
The best way to install the latest version of the Kafka server on OS X and to keep it up to date is via Homebrew.
brew search kafka
brew install kafka
The above commands will install a dependency called zookeeper which is required to run kafka. Start the zookeeper service.
zkserver start