How search can solve big data problems

There are many solutions for figuring out how to parse large amounts of data, but LucidWorks CTO Grant Ingersoll has a suggestion: use search. At GigaOM’s Structure:Data conference in New York City Thursday, Ingersoll laid out his case for why search is a big part of dealing with databases and indexes.

“Search should be a critical part of your architecture,” he told attendees. It is a system building block for any large problem you’re trying to solve that requires a ranked set of results. And it doesn’t have to be just text search, it can be for any type of search, he said.

Thinking beyond traditional search features, like keyword search, will help businesses solve those problems more easily too. And it lets organizations bring in many differing kinds of data sources and more effectively combine them.

And organizations that keep records of how people are using search to access…