# single
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.129.03 Driver Version: 535.129.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA RTX A6000 On | 00000000:05:00.0 Off | Off |
| 46% 75C P2 264W / 300W | 47067MiB / 49140MiB | 92% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
# dual
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.129.03 Driver Version: 535.129.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA RTX A6000 On | 00000000:05:00.0 Off | Off |
| 50% 78C P2 275W / 300W | 23031MiB / 49140MiB | 94% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
| 1 NVIDIA RTX A6000 On | 00000000:06:00.0 Off | Off |
| 41% 70C P2 257W / 300W | 23031MiB / 49140MiB | 93% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
# triple
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.129.03 Driver Version: 535.129.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA RTX A6000 On | 00000000:05:00.0 Off | Off |
| 30% 60C P2 130W / 300W | 21589MiB / 49140MiB | 99% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
| 1 NVIDIA RTX A6000 On | 00000000:06:00.0 Off | Off |
| 30% 54C P2 116W / 300W | 21589MiB / 49140MiB | 99% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
| 2 NVIDIA RTX A6000 On | 00000000:07:00.0 Off | Off |
| 30% 59C P2 124W / 300W | 23017MiB / 49140MiB | 99% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
# four-GPU
Thu May 23 05:36:58 2024
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.129.03 Driver Version: 535.129.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA RTX A6000 On | 00000000:05:00.0 Off | Off |
| 33% 65C P2 187W / 300W | 20795MiB / 49140MiB | 99% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
| 1 NVIDIA RTX A6000 On | 00000000:06:00.0 Off | Off |
| 30% 60C P2 169W / 300W | 20795MiB / 49140MiB | 99% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
| 2 NVIDIA RTX A6000 On | 00000000:07:00.0 Off | Off |
| 33% 65C P2 185W / 300W | 20795MiB / 49140MiB | 97% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
| 3 NVIDIA RTX A6000 On | 00000000:08:00.0 Off | Off |
| 31% 63C P2 184W / 300W | 20795MiB / 49140MiB | 99% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 3584 C /usr/bin/python3 20742MiB |
| 1 N/A N/A 3585 C /usr/bin/python3 20742MiB |
| 2 N/A N/A 3586 C /usr/bin/python3 20742MiB |
| 3 N/A N/A 3587 C /usr/bin/python3 20742MiB |
+---------------------------------------------------------------------------------------+
Last active
May 23, 2024 06:04
-
-
Save bigsnarfdude/193ee00f46c94ee7fb6f048588bc8032 to your computer and use it in GitHub Desktop.
fsdp-qlora-VRAM-TABLE-70b-llama3.md
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment