So I've been working on a Proof of Concept with the new Informix Warehouse Accelerator. Part of that is getting data from source systems , and often those source systems are on another Database system. When doing work with that you inevitably use an ETL tool of some sort, and the customer I'm working with uses IBM Datatastage.

I'm using an older version of Datastage, and the ODBC driver is slow. SO I was looking for a quicker way to load, while at the same time not taking up any space, except inside the database. So I wanted to share the method used:

Now one thing to keep in mind is that if trusting is not enabled then the window doing the cat and redirect for the pipes may need a password entered. So far this has been at least 8x faster than ODBC, and note the other peice. I only used 1 pipe, Obviously you can use as many pipes as Datastage will allow. I also didn't use PDQ which would have increased performance for my fragmented table too.