Skip to content

Instantly share code, notes, and snippets.

@ranchodeluxe
Last active March 18, 2024 12:43
Show Gist options
  • Save ranchodeluxe/d4e9de1b8f174e6a68c104dd35104e3c to your computer and use it in GitHub Desktop.
Save ranchodeluxe/d4e9de1b8f174e6a68c104dd35104e3c to your computer and use it in GitHub Desktop.
FailMatrix.md
  • all runs below use LocalDirectRunner
  • all runs below should attempt to run in under 60 minutes so we don't hit token expiry (only for EDL https/s3 auth)
  • when we say cached "disabled" we mean you never set c.InputCacheStorage.fsspec_class in your config

Protected Bucket via EDL Temp Token

https://github.com/ranchodeluxe/staged-recipes/tree/gpm_zarr_failcase

Source s3://gesdisc-cumulus-prod-protected s3://gesdisc-cumulus-prod-protected s3://gesdisc-cumulus-prod-protected
Auth Mode temp token temp token temp token
Cache Type disabled local s3
Job Behavior hangs completes hangs

Protected Bucket via Assume Role

https://github.com/ranchodeluxe/staged-recipes/tree/gpm_zarr_failcase_assumerole

Source s3://gesdisc-cumulus-prod-protected s3://gesdisc-cumulus-prod-protected s3://gesdisc-cumulus-prod-protected
Auth Mode assume role assume role assume role
Cache Type disabled local s3
Job Behavior completes completes completes

Public Bucket

https://github.com/ranchodeluxe/staged-recipes/tree/gpm_zarr_nofailcase

Source s3://pangeo-forge-uah-test-output s3://pangeo-forge-uah-test-output s3://pangeo-forge-uah-test-output
Auth Mode public bucket public bucket public bucket
Cache Type disabled local s3
Job Behavior completes completes completes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment