1 Answer

You can write the file first to your directory (pipeline 1), from there you can connect a file source to S3 and select the option "whole file" (pipeline 2). In this case the filename does not change and also no timestamp is added in the filename.

Comments

I tried doing the way you mentioned but in the second pipeline[local FS to s3] i am getting the below exception when data flows
com.streamsets.pipeline.api.base.OnRecordErrorException: S3_52 - Cannot Write Record : java.lang.IllegalArgumentException: Record does not contain the mandatory fields /fil