Skip to content

Instantly share code, notes, and snippets.

@luxzia

luxzia/Big_data_applications.csv

Created June 11, 2021 15:54
Show Gist options
  • Save luxzia/41a256830a8a2b2b630e09092a7c74e9 to your computer and use it in GitHub Desktop.
Save luxzia/41a256830a8a2b2b630e09092a7c74e9 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
Big_data_applications.csv
Topic HDP IBM Cloud Pak for Data
Spark Cluster Static cluster created at the time of install Cluster of pods created dynamically on a Kubernetes during Spark submission
Data Storage Options HDFS COS, OCS, NFS, HDFS
Application jar/dependency location HDFS, OS file system Applicatoin volume on prefered storage class (COS/OCS/NFS)
Job Submission methods Command line spark-summit, Spark launcher API, Livy (REST) API Analytics Engine REST API
Job Management APIs YARN, Livy Analytics Engine REST API
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment