Description of the first stress test: Transfering 6 millions of records from a Flat File, to CSV file.

As in most of the Test, there are several cases using differents techniques, setting of variables, with the same objective, satisfy the requirement and improve the performance. Always the first case is the best, and the rest of cases, are jobs without tuning, or an incomplet set of techniques (but helped on the way).

To measure elapsed time reading and writing 6 million rows, from Flat file, to .CSV file, working on local disk.

Rows:

6.024.000 M

Columns:

37Columns

Resources:

Virtual machine with: 2 GB RAM, Clover like main process over the virtual plataform. The resources used are anecdotal, today, Any production environment has enough processing power for current and future requirements. The objective here, is to build, to execute and to measure with the same environment (regardless of the limited resources)

Structure:

Design & Run

Elapsed time (s)

214 Secs.

Rows per sec (avg)

Here, show the evolution of the passage of rows via the transformations, each 5 seconds.

To measure elapsed time reading and writing 6 million rows, from Flat file, to .CSV file, working on local disk.

Rows:

6.024.000 M

Columns:

37Columns

Resources:

Virtual machine with: 2 GB RAM, Clover like main process over the virtual plataform. The resources used are anecdotal, today, Any production environment has enough processing power for current and future requirements. The objective here, is to build, to execute and to measure with the same environment (regardless of the limited resources)

Structure:

Design & Run

Elapsed time (s)

503 sec.

Rows per sec (avg)

Here, show the evolution of the passage of rows via the transformations, each 5 seconds.