Common Destination component properties

Indicates whether the mapping is stored in a variable. This parameter has the options listed in the following table.

Value

Description

True

The mapping is stored in a variable. Selecting the value displays the dynamic option MappingVariable.

False

The mapping is specified in a File connection manager. Selecting the value displays the dynamic option Mapping.

Mapping

Select an existing File connection manager, or click <New connection...> to create a connection manager. The columns mapping should be specified as key to value text, where each mapping is separated with newline like:

Common Transformation component properties

Enabled

Set component to be processed dynamically.

Aggregate Transformation

AggregateConfigurationVariable

Select variable containing ADO.NET DataSet or OLEDB Recordset object. The object should contain aggregate configuration for dynamic columns. You can specify multiple aggregate configurations per column. The configuration consists of the columns listed in the following table.

Column

Description

InputColumn

Dynamic column name.

Output

Name of data flow output where aggregate is created.

AggregationType

Aggregation type. This column has the options listed in the following table.

Value

Description

0

Group By

1

Count

3

Count Distinct

4

Sum

5

Average

6

Min

7

Max

IsBig

Indicates whether the column used in aggregation is high-precision or containing large numeric values. Optional. This column has the options listed in the following table.

Value

Description

0

The column is not high-precision.

1

The column is high precision or contains large numeric values. Default.

AggregationComparisonFlags

Aggregation comparison flags. Optional. Multiple options can be combined with bitwise OR. This column has the options listed in the following table.

Character Map Transformation

CharacterConfigurationVariable

Select variable containing ADO.NET DataSet or OLEDB Recordset object. The object should contain character map configuration for dynamic columns. You can specify multiple character map configurations per column. The configuration consists of the columns listed in the following table.

Column

Description

InputColumn

Dynamic column name.

MapFlags

Character operation flags. Multiple options can be combined with bitwise OR. This column has the options listed in the following table.

Conditional Split Transformation

OutputsExpressionVariable

Select variable containing string, Array, ADO.NET DataSet or OLEDB Recordset object. Each specified element contains SSIS expression for the respective conditional split output. The number of elements should match the number of outputs. If you use string, separate each expression with newline.

Copy Column Transformation

CopyConfigurationVariable

Select variable containing ADO.NET DataSet or OLEDB Recordset object. The object should contain copy column configuration for dynamic columns. You can specify multiple copies per column. The configuration consists of the columns listed in the following table.

Data Conversion Transformation

ConvertConfigurationVariable

Select variable containing ADO.NET DataSet or OLEDB Recordset object. The object should contain data conversion configuration for dynamic columns. You can specify multiple data conversion configurations per column. The configuration consists of the columns listed in the following table.

Column

Description

InputColumn

Dynamic column name.

ResultColumn

Dynamic output column name.

DataType

Output column data type. You have to specify SSIS data type.

Length

Output column length.

Precision

Output column precision.

Scale

Output column scale.

CodePage

Output column code page.

FastParse

Indicates whether fast parse option is used. This column has the options listed in the following table.

Export Column Transformation

ColumnConfigurationVariable

Select variable containing ADO.NET DataSet or OLEDB Recordset object. The object should contain configuration for dynamic columns. The configuration consists of the columns listed in the following table.

Column

Description

InputColumn

Dynamic column name, which contains data to export.

ResultColumn

Contains file path to export location.

WriteBOM

Indicates whether a byte-order mark (BOM) is written to the file. Optional. This column has the options listed in the following table.

Value

Description

0

BOM is not written. Default.

1

BOM is written.

ForceTruncate

Indicates whether an existing file is truncated. Optional. This column has the options listed in the following table.

Value

Description

0

File is not truncated.

1

File is truncated. Default.

AllowAppend

Indicates whether an existing file is appended. Optional. This column has the options listed in the following table.

Fuzzy Grouping Transformation

ColumnConfigurationVariable

Select variable containing ADO.NET DataSet or OLEDB Recordset object. The object should contain configuration for dynamic columns. The configuration consists of the columns listed in the following table.

Column

Description

InputColumn

Dynamic column name.

ResultColumn

Pass-thru column name. Optional.

MatchType

Fuzzy grouping match type. Optional. This column has the options listed in the following table.

Value

Description

1

Exact match.

2

Fuzzy match. Default.

Numerals

Indicates the significance of leading and trailing numerals in comparing the column data. Optional. This column has the options listed in the following table.

Value

Description

0

Neither. Default.

1

Leading.

2

Trailing.

3

Leading and Trailing.

MinSimilarity

Indicates the similarity threshold at the join level. Optional. The default is 0.

FuzzyComparisonFlags

String comparison flags. Optional. The default is 1. Multiple options can be combined with bitwise OR. This column has the options listed in the following table.

HEX

Description

0x00001

Ignore case.

0x00002

Ignore nonspacing characters.

0x00004

Ignore symbols.

0x01000

Sort punctuation as symbols.

0x10000

Ignore kana type.

0x20000

Ignore character width.

GroupColumn

Fuzzy group column name. Optional. The default is [dynamic column]_clean.

Select variable containing ADO.NET DataSet or OLEDB Recordset object. The object should contain configuration for dynamic columns. The configuration consists of the columns listed in the following table.

Column

Description

InputColumn

Dynamic column name.

JoinToReferenceColumn

Reference column name.

ResultColumn

Result column name. Optional. If not specified, reference column name is used.

JoinType

Fuzzy match type. Optional. This column has the options listed in the following table.

Value

Description

1

Exact match.

2

Fuzzy match. Default.

MinSimilarity

Indicates the similarity threshold at the join level. Optional. The default is 0.

FuzzyComparisonFlags

String comparison flags. Optional. The default is 0. Multiple options can be combined with bitwise OR. This column has the options listed in the following table.

HEX

Description

0x00001

Ignore case.

0x00002

Ignore nonspacing characters.

0x00004

Ignore symbols.

0x01000

Sort punctuation as symbols.

0x10000

Ignore kana type.

0x20000

Ignore character width.

FuzzyComparisonFlagsEx

Mapping flags. Optional. The default is 0. Multiple options can be combined with bitwise OR. This column has the options listed in the following table.

Import Column Transformation

ColumnConfigurationVariable

Select variable containing ADO.NET DataSet or OLEDB Recordset object. The object should contain configuration for dynamic columns. The configuration consists of the columns listed in the following table.

Lookup Transformation

Lookup Plus Transformation

ColumnConfigurationVariable

Select variable containing ADO.NET DataSet or OLEDB Recordset object. The object should contain configuration for dynamic columns. The configuration consists of the columns listed in the following table.

Table Difference Transformation

ColumnConfigurationVariable

Select variable containing ADO.NET DataSet or OLEDB Recordset object. Optional. The object should contain configuration for dynamic columns. The configuration consists of the columns listed in the following table.

Column

Description

InputColumn

Dynamic column name.

KeyOrder

Column key order. Optional. If not specified, it will use the column key order from upstream component.

UpdateID

Column update output identifier. Optional. If not specified, it will use the first update output.

Option

Column type. Optional. This column has the options listed in the following table.

FAQ

How to create completely dynamic data flow?

Starting from 1.4 SR-3 the data flow can be completely dynamic - the need to have one common column across different iteration sets is no longer required. To have completely dynamic components, you have to remove all statically defined columns (both in the components and related connection managers). However there are components, which require at least one column to pass successfully validation. We have implemented a workaround, which is based on thunk (not used) column. If you encounter a component requiring at least one column, define a column named THUNK_COLUMN. This column will be maintained and ignored at runtime by the Data Flow Task Plus.

Dynamic Column Custom Handler

To setup custom routine in the data flow script for additional setup of dynamically added data flow column, attribute your script main class with DataFlowColumnAdded attribute. Set as parameter the name of the script method. Check below the required handler method layout.