Shreyas Cholia

Biographical Sketch

Shreyas Cholia leads the science gateway, web and grid efforts at NERSC, with the goal of making high-performance and distributed computing more transparent and accessible. He is particularly interested in how web APIs and tools can facilitate data-centric computing, and is the lead developer of NEWT (a REST API and service for HPC). He has also been involved in various data related efforts at NERSC since 2002. Prior to his appointment at NERSC, Shreyas was a developer and consultant at IBM. He graduated from Rice University, where he double majored in Computer Science and Cognitive Sciences.

Electron microscopy (EM) instrumentation is making a detector-driven transition to Big Data. High capability cameras bring new resolving power but also an exponentially increasing demand for bandwidth and data analysis. In practical terms this means that users of advanced microscopes find it increasingly challenging to take data with them and instead need an integrated data processing pipeline. in 2013 NERSC and NCEM staff embarked on a pilot to prototype data services that provide such a pipeline. This tech report details the NCEM Hub pilot as it concluded in May 2014.