Rumblings with Banzai Cloud Logging operator

README.md

Title
Rumblings with BanzaiClouds Logging operator

Starting up in minikube

minikube -p banzai-log start --memory 24000 --cpus 4 --disk-size 100

First up setting up an elastic search via Elastic Cloud Operator

Based on my previous rumblings.

kubectl apply -f https://download.elastic.co/downloads/eck/1.2.0/all-in-one.yaml
kubectl apply -f https://gist.githubusercontent.com/neilus/067675001cd89242a7a3e4403c05848d/raw/8f7a27fb7106eadb31e1dd80c812022ca381d149/pv-standard.yaml
kubectl apply -f quickstart-es+kibana.yaml

Installing Banzai Clouds Kafka Operator

Based on: https://banzaicloud.com/docs/supertubes/kafka-operator/install-kafka-operator/#kafka-operator-helm

Installing the prereqs

Cert Manager

helm repo add jetstack https://charts.jetstack.io
helm repo update
helm install cert-manager --namespace cert-manager --create-namespace --version v0.15.1 jetstack/cert-manager

Zookeeper

helm repo add banzaicloud-stable https://kubernetes-charts.banzaicloud.com/A
helm repo update
kubectl create namespace zookeeper
helm install zookeeper-operator --namespace=zookeeper banzaicloud-stable/zookeeper-operator

kubectl create --namespace zookeeper -f - <<EOF
apiVersion: zookeeper.pravega.io/v1beta1
kind: ZookeeperCluster
metadata:
  name: zookeeper
  namespace: zookeeper
spec:
  replicas: 3
EOF

Prometheus Operator

Prometheus-operator and CustomResourceDefinitions
kubectl apply -n default -f
https://raw.githubusercontent.com/coreos/prometheus-operator/master/bundle.yaml

Install Kafka operator using helm

helm repo add banzaicloud-stable https://kubernetes-charts.banzaicloud.com/
helm repo update
kubectl create namespace kafka
helm install kafka-operator --namespace=kafka banzaicloud-stable/kafka-operator

Test provisioned Kafka Cluster

see: https://banzaicloud.com/docs/supertubes/kafka-operator/test/

Setting up the Logging operator

details: https://banzaicloud.com/docs/one-eye/logging-operator/deploy/#deploy-logging-operator-with-helm

helm repo add banzaicloud-stable https://kubernetes-charts.banzaicloud.com
helm repo update
kubectl create namespace logging
helm install --namespace logging logging banzaicloud-stable/logging-operator --set createCustomResource=false

quickstart-es+kibana.yaml

---
apiVersion: elasticsearch.k8s.elastic.co/v1
kind: Elasticsearch
metadata:
  name: quickstart
spec:
  version: 7.8.1
  http:
    tls:
      selfSignedCertificate:
        disabled: true
  nodeSets:
  - name: default
    count: 1
    config:
      node.master: true
      node.data: true
      node.ingest: true
      node.store.allow_mmap: false
---
apiVersion: kibana.k8s.elastic.co/v1
kind: Kibana
metadata:
  name: quickstart
spec:
  version: 7.8.1
  http:
    tls:
      selfSignedCertificate:
        disabled: true
  count: 1
  elasticsearchRef:
    name: quickstart