IARPA Seeks Partners in Brain-Inspired AI Initiative

By Tiffany Trader

January 22, 2015

US intelligence officials have set in motion a five-year project to spark progress in machine learning by reverse-engineering the algorithms of the human brain. The Intelligence Advanced Research Projects Agency (IARPA) recently put out a call for innovative solutions with the greatest potential to advance theories of neural computation as part of the Machine Intelligence from Cortical Networks (MICrONS) program. The agency, known for its funding of high-risk/high-payoff research in support of national intelligence, is ultimately looking to facilitate the development of synthetic systems with brain-like performance and proficiency.

In a just-issued broad agency announcement, IARPA lays out its strategy for fostering multidisciplinary approaches at the intersection of data science and neuroscience that increase scientific understanding of the cortical computations underlying neural information processing. Although there has been much progress in modeling machine learning algorithms after neural processes, the brain remains far better-suited for a host of detection and recognition tasks.

The agency sees the emerging research area of neurally-inspired machine learning as crucial for closing the performance gap between software and wetware.

“Despite significant progress in machine learning over the past few years, today’s state of the art algorithms are brittle and do not generalize well,” the proposal’s authors contend. “In contrast, the brain is able to robustly separate and categorize signals in the presence of significant noise and non-linear transformations, and can extrapolate from single examples to entire classes of stimuli. This performance gap between software and wetware persists despite some correspondence between the architecture of the leading machine learning algorithms and their biological counterparts in the brain, presumably because the two still differ significantly in the details of operation. The MICrONS program is predicated on the notion that it will be possible to achieve major breakthroughs in machine learning if we can construct synthetic systems that not only resemble the high-level blueprints of the brain, but also employ lower-level computing modules derived from the specific computations performed by cortical circuits.”

The MICrONS program consists of three Technical Areas (TAs), defined as follows:

TA3 – reconstruction of cortical circuits from neuroanatomical data and development of information technology systems to store, align, and access neural circuit reconstructions with the associated neurophysiological and neuroanatomical data.

“Over the course of the program, participants will use their improving understanding of the representations, transformations, and learning rules employed by the brain to create ever more capable neurally-derived machine learning algorithms,” the IARPA proposal further explains. “Ultimate computational goals for MICrONS include the ability to perform complex information processing tasks such as one-shot learning, unsupervised clustering, and scene parsing, aiming towards human-like proficiency.”

MICrONS is set to run from September 2015 through September 2020. A summary of the scientific and technical objectives of each program phase as well as a very comprehensive set of metrics for each of the technical areas are detailed in the full 70-page solicitation [PDF].

It’s been a good two weeks, AMD’s Gary Silcott and Andy Parma told me on the last day of SC18 in Dallas at the restaurant where we met to discuss their show news and recent successes. Heck, it’s been a good year. Read more…

By Tiffany Trader

Last January Thierry Pellegrino, a long-time Dell/Dell EMC veteran, became vice president of HPC. His tenure comes at a time when the very definition of HPC is blurring with AI writ large (data analytics, machine learnin Read more…

By John Russell

A powerhouse concept in attaining new knowledge is the notion of the “emergent property,” the combination of formerly stovepiped scientific disciplines and exploratory methods to form cross-disciplinary intelligence Read more…

By Doug Black

HPE Extreme Performance Solutions

As you continue to dive deeper into AI, you will discover it is more than just deep learning. AI is an extremely complex set of machine learning, deep learning, reinforcement, and analytics algorithms with varying compute, storage, memory, and communications needs. Read more…

The CORAL supercomputers Summit and Sierra are now the world's fastest computers and are already contributing to science with early applications. Ahead of SC18, Maciej Chojnowski with ICM at the University of Warsaw discussed the details of the CORAL project with Dr. Dimitri Kusnezov from the U.S. Department of Energy. Read more…

By Maciej Chojnowski

It’s been a good two weeks, AMD’s Gary Silcott and Andy Parma told me on the last day of SC18 in Dallas at the restaurant where we met to discuss their show news and recent successes. Heck, it’s been a good year. Read more…

By Doug Black

The CORAL supercomputers Summit and Sierra are now the world's fastest computers and are already contributing to science with early applications. Ahead of SC18, Maciej Chojnowski with ICM at the University of Warsaw discussed the details of the CORAL project with Dr. Dimitri Kusnezov from the U.S. Department of Energy. Read more…

By Doug Black

For nearly two hours on Monday at SC18, Jensen Huang, CEO of Nvidia, presented his expansive view of the future of HPC (and computing in general) as only he can do. Animated. Backstopped by a stream of data charts, product photos, and even a beautiful image of supernovae... Read more…

By John Russell

High performance storage vendor Panasas has launched a new version of its ActiveStor product line this morning featuring what the company said is the industry’s first plug-and-play, portable parallel file system that delivers up to 75 Gb/s per rack on industry standard hardware combined with “enterprise-grade reliability and manageability.” Read more…

By Dan Olds

Cray revealed today the details of its next-gen supercomputing architecture, Shasta, selected to be the next flagship system at NERSC. We've known of the code-name "Shasta" since the Argonne slice of the CORAL project was announced in 2015 and although the details of that plan have changed considerably, Cray didn't slow down its timeline for Shasta. Read more…

By Tiffany Trader

It’s been a good two weeks, AMD’s Gary Silcott and Andy Parma told me on the last day of SC18 in Dallas at the restaurant where we met to discuss their show news and recent successes. Heck, it’s been a good year. Read more…

By Tiffany Trader

Riding healthy U.S. and global economies, strong demand for AI-capable hardware and other tailwind trends, the high performance computing server market jumped 28 percent in the second quarter 2018 to $3.7 billion, up from $2.9 billion for the same period last year, according to industry analyst firm Hyperion Research. Read more…

By Tiffany Trader

For nearly two hours on Monday at SC18, Jensen Huang, CEO of Nvidia, presented his expansive view of the future of HPC (and computing in general) as only he can do. Animated. Backstopped by a stream of data charts, product photos, and even a beautiful image of supernovae... Read more…