Development of two Science Investigator-led Processing Systems (SIPS) for NASA's Earth Observation System (EOS)

While building a series of large data processors for remotely sensed data, GSFC LTP generalized the approach and developed a universal system architecture. With a suite of plug-in modules for a variety of functions, the design is a customizable data processing system driven by a rich set of automated production rules. It can take high volumes of diverse inputs, recognize data set types, run many separate processes simultaneously as well as sequentially against the data, and automatically send resulting products to end users. Implemented with commodity hardware and open source software, the highly scalable system has been proven in a number of applications ranging in size from tiny to huge.