Validator Transform

Details

Added Validator Transform, This will allow users to validate records based on a set of available validators and configure to write invalid records to an error dataset.

Rank:

1|hzyyjr:

Description

user wants to create a pipeline that reads from a source (in batch or realtime) and runs validation to make sure data is as expected. If there is data that is invalid, it should be written to a dataset to be examined later. If data is valid, it should be passed on to the next stage.