CB Bohn is a senior database engineer at Etsy, and a user of HP’s Vertica database. The online marketplace uses the publicCloud for some workloads, but its primary functions are run out of a co-location center, Bohn said. It doesn't make sense for the company to lift and shift its Postgres, Vertica SQL and Hadoop workloads into the public coud, he said. It would be a massive undertaking for the company to port all the data associated with those programs into the cloud. Then, once its transferred to the cloud, the company would have to pay ongoing costs to store it there. Meanwhile, the company has a co-lo facility already set up and expertise in house to manage the infrastructure required to run those programs. The cloud just isn’t a good fit for Etsy’s big data, Bohn says.

Chris Selland, VP of Business Development at HP’s Big Data software division, says most of the company’s customers aren’t using the cloud in a substantial way with big data. Perhaps that’s because HP’s Big Data Cloud, named Helion, isn’t quite as mature as say Amazon Web Services or Microsoft Azure. But still, Selland said there are both technical challenges (like data portability, and data latency) along with non-technical reasons, such as company executives being more comfortable with the data not being the cloud.

Bohn isn’t totally against the Cloud though. For quick, large processing jobs the Cloud is great. “Spikey” workloads that need fast access to large amounts of compute resources are ideal for the cloud. But, if an organization has a constant need for compute and storage resources, it can be more efficient to buy commodity hardware and run it yourself.

Public cloud vendors like Amazon Web Services make the opposite argument. I asked Amazon.com CTO Werner Vogels about private Clouds recently and he argued that businesses should not waste time on building out datacentre infrastructure when AWS can supply it to them. Bohn argues that it’s cheaper to just buy the equipment than to rent it over the long-term.

As the public Cloud has matured, it’s clear there’s still a debate about what workloads the Cloud is good for and which it’s not.

The real answer to this question is that it depends on the business. For startup companies who were born in the Cloud and have all their data in the Cloud, it will make sense to do your data processing in the Cloud. For companies that have Big Data center footprints, or co-location infrastructure set up, then there may not be a reason to lift and shift to the Cloud. Each business will have its own specific use cases, some of which may be good for the Cloud, and others which may not be.

Copyright 2018 IDG Communications. ABN 14 001 592 650. All rights reserved. Reproduction in whole or in part in any form or medium without express written permission of IDG Communications is prohibited.