Abstract

The challenges to push computing to exaflop levels are difficult given desired targets
for memory capacity, memory bandwidth, power efficiency, reliability, and cost.
This paper presents a vision for an architecture that can be used to construct exascale
systems. We describe a conceptual Exascale Node Architecture (ENA), which is the
computational building block for an exascale supercomputer. The ENA consists of an
Exascale Heterogeneous Processor (EHP) coupled with an advanced memory system. The EHP
provides a high-performance accelerated processing unit (CPU+GPU), in-package
high-bandwidth 3D memory, and aggressive use of die-stacking and chiplet technologies
to meet the requirements for exascale computing in a balanced manner. We present initial
experimental analysis to demonstrate the promise of our approach, and we discuss
remaining open research challenges for the community.