NVIDIA HGX-2

We’re at the dawn of a new age of intelligence, where deep learning, machine learning and high performance computing (HPC) are transforming our world. From autonomous vehicles, and optimizing retail logistics, to global climate simulations, new challenges are emerging whose solutions demand enormous computing resources. NVIDIA HGX-2 is a single flexible and powerful platform to solve these massive challenges with multi-precision computing—fusing the power of high-precision scientific computing with the speed of reduced-precision AI computing.

Enables “the World’s Largest GPU”

Accelerated by 16 NVIDIA® Tesla® V100 GPUs and NVIDIA NVSwitch™, HGX-2 has the unprecedented compute power, bandwidth, and memory topology to train massive models, analyze datasets, and solve simulations faster and more efficiently. The 16 Tesla V100 GPUs work as a single unified 2-petaFLOP accelerator with half a terabyte (TB) of total GPU memory, allowing it to handle the most computationally intensive workloads and enable "the world’s largest GPU."

AI Training: HGX-2 Replaces 300 CPU-Only Server Nodes

Driving Next-Generation AI Deep Learning to Faster Performance

AI deep learning models are exploding in complexity and require large memory, multiple GPUs, and an extremely fast connection between the GPUs to work. With NVSwitch connecting all GPUs and unified memory, HGX-2 provides the power to handle these new models for faster training of advanced AI. A single HGX-2 replaces 300 CPU-powered servers, saving significant cost, space, and energy in the data center.

HPC: HGX-2 Replaces up to 156 CPU-Only Server Nodes

The Highest-Performing HPC Supernode

HPC applications require strong server nodes with the computing power to perform a massive number of calculations per second. Increasing the compute density of each node dramatically reduces the number of servers required, resulting in huge savings in cost, power, and space consumed in the data center. For HPC simulations, high-dimension matrix multiplication requires a processor to fetch data from many neighbors to facilitate computation, making GPUs connected by NVSwitch ideal. A single HGX-2 server replaces up to 156 CPU based servers in science applications.

NVSwitch for Full-Bandwidth Computing

NVSwitch enables every GPU to communicate with every other GPU at full bandwidth of 2.4TB/sec to solve the largest of AI and HPC problems. Every GPU has full access to 0.5TB of aggregate HBM2 memory at a bandwidth of 16TB/s to handle the most massive of datasets. By enabling a unified server node, NVSwitch dramatically accelerates complex AI deep learning, AI machine learning, and HPC applications.

The NVSwitch topology diagram shows the connection of two GPUs for simplicity. All 16 GPUs connect to NVSwitch in the same way.

HGX-1 Reference Architecture

Powered by NVIDIA Tesla GPUs and NVLink

NVIDIA HGX-1 is a reference architecture that standardized the design of data centers accelerating AI in the cloud. Based on eight Tesla SXM2 V100 boards, a hybrid cube mesh topology for scalability, and 1 petaFLOP of compute power, its modular design works seamlessly in hyperscale data centers and delivers a quick, simple path to AI.

Empowering the Data Center Ecosystem

NVIDIA partners with the world’s leading manufacturers to rapidly advance AI cloud computing. NVIDIA provides HGX-2 GPU baseboards, design guidelines, and early access to GPU computing technologies for partners to integrate into servers and deliver at scale to their data center ecosystems.

Get the Latest from NVIDIA
on Data Center

LIMITED TIME OFFER: $49,900 ON NVIDIA DGX STATION

For a limited time only, purchase a DGX Station for $49,900 - over a 25% discount - on your first DGX Station purchase.* Additional Station purchases will be at full price.
Reselling partners, and not NVIDIA, are solely responsible for the price provided to the End Customer. Please contact your reseller to obtain final pricing and offer details.
Discounted price available for limited time, ending April 29, 2018. May not be combined with other promotions. NVIDIA may discontinue promotion at any time and without advance notice.