Skip to content

Instantly share code, notes, and snippets.

@tommydangerous

tommydangerous/mage_delta-lake_upload_battle-history.py

Last active May 11, 2023 17:49
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save tommydangerous/82758f6a6171e61dd570d1221b78fa93 to your computer and use it in GitHub Desktop.
Save tommydangerous/82758f6a6171e61dd570d1221b78fa93 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
mage_delta-lake_upload_battle-history.py
from deltalake.writer import write_deltalake
write_deltalake(
# Change this URI to your own unique URI
's3://mage-demo-public/battle-history/1337',
data=df,
mode='overwrite',
overwrite_schema=True,
storage_options={
'AWS_REGION': '...',
'AWS_ACCESS_KEY_ID': '...',
'AWS_SECRET_ACCESS_KEY': '...',
'AWS_S3_ALLOW_UNSAFE_RENAME': 'true',
},
)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment