Skip to content

Instantly share code, notes, and snippets.

@c0mpiler
Created March 22, 2023 19:33
Show Gist options
  • Save c0mpiler/6aa6e3c2cf5b7e82499cbbeea5c95a9e to your computer and use it in GitHub Desktop.
Save c0mpiler/6aa6e3c2cf5b7e82499cbbeea5c95a9e to your computer and use it in GitHub Desktop.
#! /usr/bin/env bash
time spark-submit \
--deploy-mode client \
--master spark://spark-master:7077 \
--conf spark.driver.host=spark-master \
--conf spark.executor.memory=2g \
--conf spark.driver.memory=1g \
"$@"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment