Skip to content

Instantly share code, notes, and snippets.

@rmoff
Last active April 27, 2023 16:18
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save rmoff/677ba32ff194ca976dfd4d492c2c0b43 to your computer and use it in GitHub Desktop.
Save rmoff/677ba32ff194ca976dfd4d492c2c0b43 to your computer and use it in GitHub Desktop.
Display the source blob
Display the rendered blob
Raw
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@chrigehr
Copy link

Aren't you missing a spark.conf.unset("spark.wap.branch") before step 11 to "leave" the branch?

@rmoff
Copy link
Author

rmoff commented Apr 27, 2023

@chrigehr yes you're right, that was the issue. I should remove the gist - it's superseded by tabular-io/docker-spark-iceberg#76.

thanks.

@chrigehr
Copy link

no problem @rmoff . I found the gist by accident when I was looking for information on what works (and what doesn't) with Spark 3.1 regarding branching and tagging, and what the status is regarding Spark 3.3.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment