Skip to content

Instantly share code, notes, and snippets.

View xk2600's full-sized avatar

Chris Stephan xk2600

View GitHub Profile
@xk2600
xk2600 / using_zfs_version_control_large_datasets.md
Created September 29, 2020 16:10 — forked from CMCDragonkai/using_zfs_version_control_large_datasets.md
Using ZFS to Version Control Large Datasets #zfs

Using ZFS to Version Control Large Datasets

Imagine you are a machine learning engineer. You're dealing with large datasets.

You are about to perform a large scale change to the data. Or even a small change.

You wish you had your data under version control. You wish you had a git for data.

But the data is too big for git. So you usually just backup via a copy.