Skip to content

Instantly share code, notes, and snippets.

@jacobtomlinson

jacobtomlinson/Performance comparison of s3fs, goofys and pysssix.ipynb

Created August 2, 2018 13:57
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jacobtomlinson/8ef089b52531cfbf4624a8dc433bfb21 to your computer and use it in GitHub Desktop.
Save jacobtomlinson/8ef089b52531cfbf4624a8dc433bfb21 to your computer and use it in GitHub Desktop.
Download ZIP
I've been experimenting with an ~80GB zarr file created with xarray and wanted to compare performance between using s3fs and FUSE (goofys and pysssix specifically).
Display the source blob
Display the rendered blob
Raw
Performance comparison of s3fs, goofys and pysssix.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment