You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Top-Down Morton code BVH Tree construction + existing hit collision detection methods
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Architecture Design Decision: Proactive Memory-Based Graceful Shutdown for Kafka Streams Pods in OpenShift
Problem Statement
Pods running in an OpenShift Kubernetes environment process complex events using Kafka Streams and KTables, with state stores backed by RocksDB. Over time, these state stores consume increasing memory until the container exceeds its memory limit, crashes, and causes data loss. To mitigate this, we need a mechanism to detect impending memory exhaustion, trigger a graceful shutdown, and allow the pod to restart without data loss.
Key Requirements
Proactive Memory Monitoring: Detect when memory usage approaches the container's limit.
Graceful Shutdown: Safely terminate Kafka Streams operations to commit state and offsets.
State Recovery: Ensure the pod resumes processing from the last committed state after restart.
Automation: Minimize manual intervention and integrate with OpenShift/Kubernetes lifecycle management.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters