Ivan Lopez askainet

## aws_gpu_list.md

      
              1 file
            
          
              0 forks
            
          
              0 comments
            
          
              0 stars
            
          
                askainet
                / aws_gpu_list.md
            
            
              Created
              March 15, 2022 11:45
                — forked from shashankprasanna/aws_gpu_list.md
            
          
Architecture
NVIDIA GPU
Instance type
Instance name
Number of GPUs
GPU Memory (per GPU)
GPU Interconnect (NVLink / PCIe)
Thermal
Design Power (TDP) from nvidia-smi
Tensor Cores (mixed-precision)
Precision Support
CPU Type
Nitro based


Ampere
A100
P4
p4d.24xlarge
8
40 GB
NVLink gen 3 (600 GB/s)
400W
Tensor Cores (Gen 3)
FP64, FP32, FP16, INT8, BF16, TF32
Intel Xeon Scalable (Cascade Lake)
Yes


Ampere
A10G
G5
g5.xlarge
1
24 GB
NA (
Architecture	NVIDIA GPU	Instance type	Instance name	Number of GPUs	GPU Memory (per GPU)	GPU Interconnect (NVLink / PCIe)	Thermal Design Power (TDP) from nvidia-smi	Tensor Cores (mixed-precision)	Precision Support	CPU Type	Nitro based
Ampere	A100	P4	p4d.24xlarge	8	40 GB	NVLink gen 3 (600 GB/s)	400W	Tensor Cores (Gen 3)	FP64, FP32, FP16, INT8, BF16, TF32	Intel Xeon Scalable (Cascade Lake)	Yes
Ampere	A10G	G5	g5.xlarge	1	24 GB	NA (