HPE Introduces the World’s Largest Single-memory Computer

Hewlett Packard Enterprise today introduced the world’s largest single-memory computer, the latest milestone in The Machine research project. The Machine, which is the largest R&D program in the history of the company, is aimed at delivering a new paradigm called Memory-Driven Computing—an architecture custom-built for the big data era.

The secrets to the next great scientific breakthrough, industry-changing innovation or life-altering technology hide in plain sight behind the mountains of data we create every day,” said Meg Whitman, CEO of Hewlett Packard Enterprise. “To realize this promise, we can’t rely on the technologies of the past, we need a computer built for the big data era.”

The prototype unveiled today contains 160 terabytes (TB) of memory, capable of simultaneously working with the data held in every book in the Library of Congress five times over—or approximately 160 million books. It has never been possible to hold and manipulate whole data sets of this size in a single-memory system, and this is just a glimpse of the immense potential of Memory-Driven Computing.

Scalability & Societal Implications

Based on the current prototype, HPE expects the architecture could easily scale to an exabyte-scale single-memory system and, beyond that, to a nearly-limitless pool of memory—4,096 yottabytes. For context, that is 250,000 times the entire digital universe today.

With that amount of memory, it will be possible to simultaneously work with every digital health record of every person on earth; every piece of data from Facebook; every trip of Google’s autonomous vehicles and every data set from space exploration all at the same time—getting to answers and uncovering new opportunities at unprecedented speeds.

We believe Memory-Driven Computing is the solution to move the technology industry forward in a way that can enable advancements across all aspects of society,” said Mark Potter, CTO at HPE and director, Hewlett Packard Labs. “The architecture we have unveiled can be applied to every computing category—from intelligent edge devices to supercomputers.”

Memory-Driven Computing puts memory, not the processor, at the center of the computing architecture. By eliminating the inefficiencies of how memory, storage and processors interact in traditional systems today, Memory-Driven Computing reduces the time needed to process complex problems from days to hours, hours to minutes, minutes to seconds, to deliver real-time intelligence.

Technical Specifications:

The new prototype builds on the achievements of The Machine research program, including:

An optimized Linux-based operating system (OS) running on ThunderX2, Cavium’s flagship second generation dual socket capable ARMv8-A workload optimized System on a Chip.

Photonics/Optical communication links, including the new X1 photonics module, are online and operational.

Software programming tools designed to take advantage of abundant persistent memory.

Cavium shares HPE’s vision for Memory-Driven Computing and is proud to collaborate with HPE on The Machine program,” said Syed Ali, president & CEO of Cavium Inc. ”HPE’s groundbreaking innovations in Memory-Driven Computing will enable a new compute paradigm for a variety of applications, including the next generation data center, cloud and high-performance computing.”

Resource Links:

Latest Video

Industry Perspectives

Addison Snell gave this talk at the Stanford HPC Conference. “Intersect360 Research returns with an annual deep dive into the trends, technologies and usage models that will be propelling the HPC community through 2017 and beyond. Emerging areas of focus and opportunities to expand will be explored along with insightful observations needed to support measurably positive decision making within your operations.” [READ MORE…]

White Papers

As the first to 40Gb/s, 56Gb/s and 100Gb/s bandwidth, Mellanox has both boosted data center and cloud performance and improved return on investment at a pace that exceeds its own roadmap. To that end, Mellanox has now announced that it is the first company to enable 200Gb/s data speeds with Mellanox Quantum switches, ConnectX-6 adapters, and LinkX cables combining for an end-to end 200G HDR InfiniBand solution in 2018. Download the new report, courtesy of Mellanox Technologies, to lean more about 200G HDR InfiniBand solutions.