（下にスクロールして本文へ）
-
読者に価値のある情報だと思うので共有: 今年は未踏ジュニアに事前応募するとプロトタイプ開発にChatGPT APIが無料で使えます。
-
以下本文
了解しました！未踏ジュニアに『採択されるために役立つ』実践的な知見を重点的に調査します。
Kanta Hayashi KantaHayashiAI
lolipopshock
/ download_hf.py
Last active
October 16, 2024 23:34
Efficiently downloads HuggingFace models by circumventing the `.git` directory. It can speed up the download process by approximately 2x by avoiding downloading the `.git` folder, which contains a copy of the models (thanks to git-lfs). This script can be especially beneficial for large models (e.g., Meta-Llama-3.1-405B).
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Efficiently downloads HuggingFace models by circumventing the `.git` directory. | |
| Speeds up the download process by approximately 2x by avoiding downloading the | |
| `.git` folder, which contains a copy of the models (thanks to git-lfs). This script | |
| can be especially beneficial for large models (e.g., Meta-Llama-3.1-405B). | |
| Usage: | |
| python download_hf.py \ | |
| <hf_repo_id> <destination_folder> \ |
iwiwi
/ 2023-09-19_chinchilla-scaling.ipynb
Created
September 19, 2023 10:53
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.