Skip to content

Instantly share code, notes, and snippets.

View TomNicholas's full-sized avatar

Tom Nicholas TomNicholas

View GitHub Profile
@TomNicholas
TomNicholas / benchmark.py
Created August 8, 2025 07:43
xarray .to_zarr scaling benchmarks
# /// script
# requires-python = ">=3.13"
# dependencies = [
# "xarray",
# "zarr",
# "matplotlib",
# ]
# ///
import asyncio
@TomNicholas
TomNicholas / benchmark_hdf.py
Last active April 9, 2025 19:30
Benchmark reading netCDF4 file via HTTP GET requests from S3
# /// script
# requires-python = ">=3.13"
# dependencies = [
# "requests",
# "h5py",
# "xarray",
# "h5netcdf",
# ]
# ///
@TomNicholas
TomNicholas / oae_refs_at_scale.ipynb
Created January 30, 2025 18:52
VirtualiZarr'ing CWorthy OAE dataset
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomNicholas
TomNicholas / test_icechunk_refs_at_scale.ipynb
Created November 20, 2024 19:59
Testing writing huge amounts of virtual references into icechunk
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomNicholas
TomNicholas / dim_coord_test.ipynb
Last active March 7, 2024 17:53
Kerchunk non-deterministic bugs
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomNicholas
TomNicholas / ConcatenatableArray.ipynb
Created February 4, 2024 21:14
Try to make a minimal ConcatenatableArray class work with xarray
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomNicholas
TomNicholas / KerchunkArray.ipynb
Last active February 20, 2024 09:13
Use xarray to concatenate kerchunked files
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomNicholas
TomNicholas / clustering_pipeline.ipynb
Created July 28, 2023 14:04
Histogram clustering pipeline
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomNicholas
TomNicholas / rotation_functional_index.ipynb
Created July 19, 2023 15:22
Rotation Functional Index
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomNicholas
TomNicholas / quadratic_means_coiled_executor.ipynb
Last active July 17, 2023 20:29
Coiled functions executor for Cubed
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.