The Coming of ETL 2.0

Study shows that data integration is still costly and requires a lot of manual coding.

Due largely to performance issues and the sheer volume of data involved, the whole extract, transform and load (ETL) process has been gaining an increasingly bad reputation within IT circles. The core issue is that current approaches to automating ETL simply don't scale, while the amount of time that IT organizations can allocate to support this kind of batch processing is shrinking.

As a result, the folks at Syncsort are starting to make a case of ETL 2.0, which in their view will soon lead ETL engines running in memory as a way to solve the current performance and scalability limitations of ETL.

In a Big Data era, the whole data integration process is lagging behind recent advancements in memory technologies. Jorge Lopez, Syncsort senior manager for data integration, says the sheer complexity of all the data sources involved in a modern application integration project are starting to overwhelm existing approaches to ETL.

Lopez says it will take a little longer before Syncsort can move its ETL engine into memory, but does say that IT organizations should start planning today for what he says will happen sooner than later. That means ETL technologies are something that IT organizations need to work around, and the next generation of ETL platforms will be technologies that IT organizations will find hard to keep up with.

At a time when data integration across multiple platforms residing both inside and outside the enterprise is increasingly becoming critical, advances in the way the whole ETL process is performed and managed can come none to soon.

IT Solutions Builder
TOP IT RESOURCES TO MOVE YOUR BUSINESS FORWARD

Which topic are you interested in?

Mobile

Security

Networks/IoT

Cloud

Data Storage

Applications

Development

IT Management

Other

What is your company size?

What is your job title?

What is your job function?

Searching our resource database to find your matches...

Subscribe to our Newsletters

Sign up now and get the best business technology insights direct to your inbox.

By submitting your information, you agree that itbusinessedge.com may send you ITBbusinessEdge offers via email, phone and text message, as well as email offers about other products and services that ITBbusinessEdge believes may be of interest to you. ITBbusinessEdge will process your information in accordance with the Quinstreet Privacy Policy.

Please enable Javascript in your browser, before you post the comment! Now Javascript is disabled.

Post a comment

Your name/nickname

Your email

WebSite

Subject

(Maximum characters: 1200). You have 1200 characters left.

Subscribe to our Newsletters

Sign up now and get the best business technology insights direct to your inbox.

By submitting your information, you agree that itbusinessedge.com may send you ITBbusinessEdge offers via email, phone and text message, as well as email offers about other products and services that ITBbusinessEdge believes may be of interest to you. ITBbusinessEdge will process your information in accordance with the Quinstreet Privacy Policy.

Subscribe to our Newsletters

Sign up now and get the best business technology insights direct to your inbox.

By submitting your information, you agree that itbusinessedge.com may send you ITBbusinessEdge offers via email, phone and text message, as well as email offers about other products and services that ITBbusinessEdge believes may be of interest to you. ITBbusinessEdge will process your information in accordance with the Quinstreet Privacy Policy.