GPU Server

NVIDIA DGX A100

8x NVIDIA A100 80GB Tensor Core GPUs
640GB total
5 petaFLOPS AI ,10 petaOPS INT8

NVIDIA DGX A100 640GB

GPUs	8x NVIDIA A100 80GB Tensor Core GPUs
GPU Memory	640GB total
Performance	5 petaFLOPS A 10 petaOPS INT8
NVIDIA NVSwitches	6
System Power Usage	6.5 kW max
CPU	Dual AMD Rome 7742, 128 cores total, 2.25 GHz (base), 3.4 GHz (max boost)
System Memory	2TB
Networking	8x Single- Port NVIDIA ConnectX-7 200Gb/s InfiniBand 2x Dual-Port NVIDIA ConnectX-7 VPI 10/25/50/100/200 Gb/s Ethernet	8x Single-Port NVIDIA ConnectX-6 VPI 200Gb/s InfiniBand 2x Dual-Port NVIDIA ConnectX-6 VPI 10/25/50/100/200 Gb/s Ethernet
Storage	OS: 2x 1.92TB M.2 NVME drives Internal Storage: 30TB (8x 3.84 TB) U.2 NVMe drives
Software	Ubuntu Linux OS Also supports: Red Hat Enterprise Linux CentOS
System Weight	271.5 lbs (123.16 kgs) max
Packaged System Weight	359.7 lbs (163.16 kgs) max
System Dimensions	Height: 10.4 in (264.0 mm) Width: 19.0 in (482.3 mm) max Length: 35.3 in (897.1 mm) max
Operating Temperature Range	5℃ to 30℃(41℉ to 86℉)