Finding The Breadcrumbs In Customer Data

Many businesses still miss the valuable insights hiding in data on consumer behavior, Teradata exec says.

Big Data Analytics Masters Degrees: 20 Top Programs

(click image for larger view and for slideshow)

The holiday travel and shopping season is upon us, creating a flurry of consumer activity. Armed with smartphones, tablets, and PCs, harried shoppers are on a not-so-jolly quest for great deals -- not only in gifts, but also in airline fares, hotel rooms, and other seasonal essentials. Not surprisingly, they're generating a lot of data too, but businesses aren't necessarily using this information to their advantage.

Companies can do a better job of extracting useful information from both consumer devices and sensors, said Tim Simmons, VP of global industry marketing at Teradata. In fact, the information is ripe for taking, altogether some effort and expense is involved.

"Consumers do things fairly consistently. We've got to uncover it," Simmons said in a phone interview with InformationWeek. "Within the big data space, you have to start with a hypothesis. You think there might be a relationship, but you can't prove it without the data helping you prove it."

For instance, online shoppers often leave a digital "trail of breadcrumbs" that businesses should follow to get a clearer understanding of their customers' behavior. To track this data, Teradata uses its Aster big data platform to translate user-generated comments from social networks and online forums into a usable "point score" for its corporate clients.

"What we're trying to do is help the customer gather this disparate, rather strange-looking data, and progressively translate into something that's consumable," said Simmons.

This is achieved, in part, via two big data applications: attribution and end path analysis. The former essentially monitors all of the possible interaction a customer could have, while the latter examines the entire path to purchase in order to help analysts determine "which bits mattered the most," Simmons said.

For instance, airlines use big data analytics to study consumer behavior, or "different points of influence," to see which online activities have the most impact. A potential customer might browse a carrier's website to explore flights to a specific destination, and arrange the options by price, number of stops, or other factors.

"You might stop browsing there, and you might not buy anything," said Simmons. But how might the airline enhance the customer's experience to improve the odds of a sale on the carrier's site?

"They want to bring the booking to their site, rather than to a travel agent, because they lose margin in what is not a very high margin business in the first place," Simmons added.

In the retail world, customer analysis can deliver benefits as well. Simmons provided a brief case study of one Teradata customer: Cabela's, a Nebraska-based outdoor merchandise retailing chain, which studied consumer behavior to determine if the first item placed in the online shopper's basket held any specific significance.

It turned out the answer was yes: First-in-basket items tended to drive purchases of ancillary products, the data showed.

"Somebody bought a tent. Well, chances are you need other things than a tent. You need chairs, a cooking device, a bunch of sleeping bags," and other camping-related items, said Simmons.

These data-driven insights helped Cabela's determine which of its 250,000 retail items would best drive purchases of other merchandise. It then built its promotional efforts around these so-called "driver items."

In addition to consumer-generated info, sensors also provide a vast, often untapped, source of big data. Enterprises face the daunting challenge of finding ways to extract value from those bits, rather than simply unload them.

Simmons recalled being at a tech industry conference recently, where an airline representative was telling the audience about the staggeringly large amount of data generated by an airplane in flight. It was mind-boggling," said Simmons. "It was like hundreds of terabytes of data before the aircraft landed."

Airline manufacturers and carriers, however, may dump that data because they're unaware of its potential value. "Nobody from a business analyst perspective has [said to] them, 'Hey, you've got this rich data, why don't you use it for maintenance? Why don't you unlock it this way?'" said Simmons. "It's a pretty good illustration of the kind of data out there that gets dumped -- it doesn't have to be dumped, obviously."

IT groups need data analytics software that's visual and accessible. Vendors are getting the message. Also in the State Of Analytics issue of InformationWeek: SAP CEO envisions a younger, greener, cloudier company. (Free registration required.)

"Many businesses still miss the valuable insights hiding in data on consumer behavior," I like this quote. Many business cannot understand the gravity of these data and what sort of actions they can take based on these.

Across company units, GE is a pioneer in what's commonly known as the Internet of things but which GE calls "the industrial Internet." Quick plug: At our InformationWeek Conference on April 1, we'll be interviewing GE Power's CIO, Jim Fowler, to get a reality check on the state of IoT applications at GE and elsewhere. http://www.informationweek.com/conference

1. The comment "you have to start with a hypothesis" kind of goes against the big data trend. With high-scale, low-cost platforms, you can capture all the data and use things like MapReduce and machine learning to uncover latent patterns. The idea of having to know what you're looking for in advance sounds like SQL-centric/relational thinking and is precicely what big data analysts are tyring to get away from.

2. From what I've heard, the likes of Boeing, GE, and the airlines they serve are ABSOLUTELY aware of the value of flight data. GE, for one, uses data streaming from many of its latest jet engines in service for prevantative maintenance. In fact, they're talking about moving to an engines-as-a-service model whereby airlines can subscribe to engines and GE takes care of keeping them in service. Boeing, Airbus and airlines also make extensive use of their flight data. Maybe they boil it down and throw away the oldest stuff, but there's no lack of awareness.

ITís tried for years to simplify data analytics and business intelligence efforts. Have visual analysis tools and Hadoop and NoSQL databases helped? Respondents to our 2014 InformationWeek Analytics, Business Intelligence, and Information Management Survey have a mixed outlook.