Skip to content

Instantly share code, notes, and snippets.

@thepycoder
Created April 25, 2022 07:40
Show Gist options
  • Save thepycoder/6c5e55c62d4fec4fcbac56cf50f05cdc to your computer and use it in GitHub Desktop.
Save thepycoder/6c5e55c62d4fec4fcbac56cf50f05cdc to your computer and use it in GitHub Desktop.
Create a ClearML dataset
# Get the previous dataset or create one if it doesn't exist yet
dataset = Dataset.get(
dataset_project=CLEARML_PROJECT,
dataset_name=CLEARML_DATASET_NAME,
auto_create=True,
writable_copy=True
)
# Add the labeled files (can include the old ones)
dataset.add_files(path=save_path, dataset_path=save_path)
# Upload only files that are new
dataset.finalize(auto_upload=True)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment