Skip to content

Instantly share code, notes, and snippets.

@betolink
Created January 30, 2024 20:33
Show Gist options
  • Save betolink/b545c364f80882c113b8cc27b763c729 to your computer and use it in GitHub Desktop.
Save betolink/b545c364f80882c113b8cc27b763c729 to your computer and use it in GitHub Desktop.
cloud optimized HDF5
Display the source blob
Display the rendered blob
Raw
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@evetion
Copy link

evetion commented Jan 31, 2024

Very interesting work, that will save many many bytes of bandwith and I/O in the long run.

@betolink
Copy link
Author

Yeah, I'm excited about this, thanks to @ajelenak for his guidance on HDF5 internals. Besides the performance improvement, a good side effect for data providers (with data on AWS) is the co$$$t reduction.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment