ksingh7

from kafka import KafkaProducer, KafkaConsumer
import json
from bson import json_util

bootstrap_server = 'my-cluster-kafka-route-bootstrap-nestjs-testing.apps.ocp.ceph-s3.com:443'

print("Producing messages to Kafka topic ...")
producer = KafkaProducer(bootstrap_servers=bootstrap_server, ssl_cafile='ca.crt', security_protocol="SSL")

for i in range(10):

ksingh7

Ngninx template for Openshift

Create a full deployment for an Nginx Proxy that reads its configuration from a config map.

The config map can be edited online and only requires a rolling deployment to take effect.

Quickstart:

oc new-app -f https://gist.githubusercontent.com/ksingh7/f6ca0c13cb9902fe96463704d27065af/raw/da5e0cf24f63de0a5b94b0497d5036e9e2f7b1f5/nginx-template.yaml -p NAME="my-proxy"

ksingh7

Deploying CRC

crc config set consent-telemetry no
crc config set enable-cluster-monitoring true
crc config set cpus 15
crc config set memory 60000
crc config view
crc setup
crc start  --log-level debug -p /mnt/hdd_space1/pull-secret.txt

ksingh7

Get Token for API Authentication

oc whoami -t

Get Prometheus Route URL

oc get route -n openshift-monitoring | grep -i prometheus

Run sample curl request

ksingh7

apiVersion: kafka.strimzi.io/v1alpha1
kind: KafkaConnector
metadata:
  name: s3-sink-connector
  labels:
    strimzi.io/cluster: my-connect-cluster
spec:
  class: org.apache.camel.kafkaconnector.CamelSinkConnector
  tasksMax: 1
  config:

ksingh7

apiVersion: kafka.strimzi.io/v1alpha1
kind: KafkaConnector
metadata:
  name: s3-sink-connector
  labels:
    strimzi.io/cluster: my-connect-cluster
spec:
  class: org.apache.camel.kafkaconnector.CamelSinkConnector
  tasksMax: 1
  config:

ksingh7

apiVersion: kafka.strimzi.io/v1beta1
kind: KafkaConnect
metadata:
  namespace: cc-demo
  name: my-connect-cluster
  annotations:
    strimzi.io/use-connector-resources: "true"
spec:
  version: 2.5.0
  image: karansingh/camel-aws2-s3-kafka-connector

ksingh7

apiVersion: kafka.strimzi.io/v1beta1
kind: Kafka
metadata:
  name: my-cluster
  labels:
    app: my-cluster
spec:
  kafka:
    version: 2.5.0
    replicas: 3

ksingh7

Tools

• Kops https://github.com/kubernetes/kops/blob/master/docs/README.md
• Kubectl https://kubernetes.io/docs/tasks/tools/install-kubectl/
• kubespy https://blog.pulumi.com/kubespy-trace-a-real-time-view-into-the-heart-of-a-kubernetes-service
• kops https://icicimov.github.io/blog/virtualization/Kubernetes-Cluster-in-AWS-with-Kops/

Presentations

ksingh7