abij

#!/bin/bash

# Inspiration based on: https://docs.databricks.com/_static/notebooks/datadog-init-script.html

# Improvements:
# - Use 'spark_url' in config (instead of resourcemanager_uri)
# - Use Databricks Secrets to store and retrieve datadog-api-key
# - Works with SingleNode-clusters
# - Update datadog-spark integration (when needed), to support Structured Streaming metrics.