Skip to content

Instantly share code, notes, and snippets.

@nfarah86

nfarah86/spark-shell.sh

Created April 19, 2023 04:52
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save nfarah86/58049ee4c8b103a965f11afb346f3980 to your computer and use it in GitHub Desktop.
Save nfarah86/58049ee4c8b103a965f11afb346f3980 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
spark-shell.sh
spark-shell \
--packages org.apache.hudi:hudi-spark3.2-bundle_2.12:0.13.0 \
--conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer' \
--conf 'spark.sql.catalog.spark_catalog=org.apache.spark.sql.hudi.catalog.HoodieCatalog' \
--conf 'spark.sql.extensions=org.apache.spark.sql.hudi.HoodieSparkSessionExtension'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment