ETE AI Server H200 with 2× NVIDIA H200 NVL 141 GB, 4U

A machine for model training and heavy inference, where GPU memory decides everything. Two NVIDIA H200 NVL cards of 141 GB each are joined by an NVLink bridge, so a workload sees 282 GB as one pool and card-to-card traffic bypasses PCIe.

Configuration

• Platform: 4U rack chassis, up to 8 GPUs, PCIe 5.0
• CPUs: 2× AMD EPYC 9355, 64 cores in total
• Memory: 1 TB DDR5-6400 ECC Registered (16× 64 GB)
• GPUs: 2× NVIDIA H200 NVL 141 GB with an NVLink bridge
• Storage: 2× 960 GB NVMe M.2 for the OS in RAID1, 4× 7.68 TB U.2 NVMe for data
• Networking: 2× 25GbE plus a dual-port 200G QSFP112 adapter
• Power: 4× 3200 W with 2+2 redundancy

Room to grow

The board takes up to four H200 NVL cards with a 4-way bridge, and memory scales to 2 TB. An NVIDIA AI Enterprise subscription is supplied separately.

How to order

Each system is built for the workload: card count, memory and storage are agreed before the order. A manager quotes the price for your configuration and the lead time. Send a request and we will calculate it.