Military Supply Data Search Tool Uses MongoDB

Niinja search engine from startup Vital Axiom taps into MongoDB to simplify searches of vast catalogue of products and parts purchased by the government.

10 Cool DARPA Projects In Development

(click image for larger view)

The Department of Defense purchases nearly 7 million types of products and does business with 2.7 million supplier companies, according to government records. Knowing what products and parts are stocked in DoD warehouses worldwide is not only a challenge for military logistics personnel, but also for suppliers who need information on products the DoD keeps in stock.

Although information about stocked products is publicly available in the Federal Logistics Information System (FLIS), the scale of the data makes FLIS difficult to search and navigate without specialized logistics training.

A Chicago-based technology startup, Vital Axiom, believes it has developed a better approach with the launch of a new search product called Niinja. The specialty search engine was built specifically for FLIS and makes data on military supplies easier to search, use, and understand with graphs, maps, and tooltips for decoding military abbreviations, says Vital Axiom's founder, Kabir Mehta.

The DoD publishes FLIS data in zip, text, and doc files on a website managed by the Defense Logistics Agency's (DLA) cataloging staff. The information is updated monthly in an electronic reading room on the website. The files, however, are large and cumbersome to use. The most common way vendors can access FLIS data is through a DLA website called WebFLIS, which requires the user to know what she is looking for, said Mehta.

Alternatively, vendors can subscribe to a monthly government service that publishes the FLIS data on a DVD and mails it to users who pay the $200 yearly subscription. That's twice the cost of Niinja, which is $99 a year, according to Mehta.

Niinja lets users perform a search in one text box and returns results in a ranked list that is sorted by relevance. Mehta explained that the process is far less complicated than using WebFLIS.

Niinja uses MongoDB, a database that supports Web-scale applications that use large sets of data. MongoDB can make multiple data searches simultaneously, for instance. Niinja also makes it easier to identify monthly database updates. As a result, Niinja is able to track all data changes for the past 12 months. This type of historical search is not available in any government-provided FLIS, Mehta said.

The technology has the ability "to search the vast datasets much more efficiently than interfaces created by DLA," said Mehta in an interview. "With the recent cuts in federal budget, and DLA's goal to save $13 billion over the next six years, it is clear to us that innovation in government technology has to come from private software developers."

The current system used by the Army is seen as archaic, said Zachary Harrison, a market research manager at Bearing Analytics, who also served 10 years in the military and has extensive experience in military logistics. An Army supply clerk's time is often spent on Google, researching what and where to buy something.

"There are many sources and various channels that can be used, but there exists no centralized location to compare prices and look at the physical location of these products," Harrison told us.

Niinja removes the research aspect, which is the most time consuming, and serves up the least expensive options available. For a commander at the company level, this makes it easier to budget allotted resources. The search engine's download option is its most valuable aspect, Harrison said. The supply codes and product information are all available in an Excel document and do not require individual data input.

Mehta said it's unclear whether the government will allocate resources to improve FLIS access beyond its Freedom of Information Act (FOIA) e-reading room with raw data files, which is why Vital Axiom is planning to provide an API for Niinja in the second quarter of 2014. Anyone with access to the API will be able to build mobile apps, business apps, and customized reports on FLIS data with Niinja as a backend.

Elena Malykhina has written for The Wall Street Journal, Scientific American, Adweek, and Newsday. She covers the federal government, including NASA's space missions, for InformationWeek.

Too many companies treat digital and mobile strategies as pet projects. Here are four ideas to shake up your company. Also in the Digital Disruption issue of InformationWeek: Six enduring truths about selecting enterprise software. (Free registration required.)

Such kind of powerful tool will definitely help not only DoD but also the industry in general. Using NoSQL DB such as Mongo is a good choice for such kind of scenario. For such kind of massive data processing, big-data should come into play. Personally I am willing to know more about how this startup performed in DoD project?

I suspect that this was less about the company getting it's foot in DoD's stockade than it was a case of a smart group of entrepreneurs seeing a market need and developing an approach that not only helped the contractor community, but also probably made life easier for military logistics folks who wouldn't have had the money or authority to build this on their own.

Anything that helps the Department of Defense track 7 million products is probably going to be worth the purchase price. These types of tools have been lacking in the past, and the NoSQL approach with its loosely defined data types is just the thing. I wonder how this startup got its foot in DOD's door?

Thanks for pointing out the MetLife example of using NoSQL/MongoDB for disparate data bases. This story points out yet again how the inefficiencies of government data reporting creates pockets of business opportunity for specialty firms to gather and package up data that otherwise is freely available but hard to process.

For MetLife the call for NoSQL was rooted in disparate data models across various acquired and organically developed product lines over a period of years. That led to disparate customer databases and the use of MongoDB to get a 360-degree view of all those customers -- a big, common problem. The Department of Defence use case explained here is another common scenario. Supply chains are invariably conglomerations of disparate commodity and part catalogs. Even vendors sellling the same goods have wildly different data models with unique numbering schemes, product descriptions and product dimensions and data.

I keep hearing NoSQL naysayers point out that NoSQL doesn't always make sense. That's certainly true, but the world is discovering that there are many use cases where it makes perfect sense.

To learn more about what organizations are doing to tackle attacks and threats we surveyed a group of 300 IT and infosec professionals to find out what their biggest IT security challenges are and what they're doing to defend against today's threats. Download the report to see what they're saying.

Transformation is on every IT organization's to-do list, but effectively transforming IT means a major shift in technology as well as business models and culture. In this IT Trend Report, we examine some of the misconceptions of digital transformation and look at steps you can take to succeed technically and culturally.