# single
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.129.03 Driver Version: 535.129.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA RTX A6000 On | 00000000:05:00.0 Off | Off |
| 37% 66C P2 213W / 300W | 17209MiB / 49140MiB | 95% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
# dual-gpu
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.129.03 Driver Version: 535.129.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA RTX A6000 On | 00000000:05:00.0 Off | Off |
| 37% 67C P2 205W / 300W | 10543MiB / 49140MiB | 64% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
| 1 NVIDIA RTX A6000 On | 00000000:06:00.0 Off | Off |
| 30% 61C P2 185W / 300W | 10543MiB / 49140MiB | 62% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
# triple-gpu
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.129.03 Driver Version: 535.129.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA RTX A6000 On | 00000000:05:00.0 Off | Off |
| 30% 58C P2 130W / 300W | 9847MiB / 49140MiB | 85% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
| 1 NVIDIA RTX A6000 On | 00000000:06:00.0 Off | Off |
| 30% 53C P2 118W / 300W | 9847MiB / 49140MiB | 94% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
| 2 NVIDIA RTX A6000 On | 00000000:07:00.0 Off | Off |
| 30% 58C P2 126W / 300W | 10469MiB / 49140MiB | 84% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
# quad-gpu
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.129.03 Driver Version: 535.129.03 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA RTX A6000 On | 00000000:05:00.0 Off | Off |
| 30% 60C P2 169W / 300W | 9595MiB / 49140MiB | 74% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
| 1 NVIDIA RTX A6000 On | 00000000:06:00.0 Off | Off |
| 30% 55C P2 150W / 300W | 9595MiB / 49140MiB | 71% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
| 2 NVIDIA RTX A6000 On | 00000000:07:00.0 Off | Off |
| 30% 60C P2 165W / 300W | 9595MiB / 49140MiB | 68% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
| 3 NVIDIA RTX A6000 On | 00000000:08:00.0 Off | Off |
| 30% 55C P2 166W / 300W | 9595MiB / 49140MiB | 59% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
Created
May 23, 2024 06:23
-
-
Save bigsnarfdude/1eb47ee4959eee5b1217c893ba91e4bf to your computer and use it in GitHub Desktop.
fsdp-qlora-VRAM-TABLE-llama3-8b.md
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment