Update(2024-12-17): 🎉 This version supports quick startup and fast recovery, automatically skipping downloaded files for efficient handling of large repos. The removal of git clone
dependency further accelerates file list retrieval.
Considering the lack of multi-threaded download support in the official huggingface-cli
, and the inadequate error handling in hf_transfer
, This command-line tool leverages curl
and aria2c
for fast and robust downloading of models and datasets.
- ⏯️ Resume from breakpoint: You can re-run it or Ctrl+C anytime.
- 🚀 Multi-threaded Download: Utilize multiple threads to speed up the download process.
- 🚫 File Exclusion: Use
--exclude
or--include
to skip or specify files, save time for models with duplicate formats (e.g.,*.bin
or*.safetensors
). - 🔐 **Auth Supp