Hi, Are you getting values in tlogrow when you don't have a connection? I guess EXCEL is the key issue I guess. Can you please right click on Excel cell where you have got the Date values and check their format and check if it's date. Pls make sure it matches with what you have in the Excel Metadata schema. You can remove the tmap and null check up and map it directly. Cheers! Gatha
... View more

Hi, I am not very sure of the way teradata works. with my little understand of Teradata , I am giving my idea. Use one Teradataconnection at the start of the process and reuse the connection across your job. use a tTeradatarow component to create volatile table, you can always have the structure of your volatile table in the Metadata(without the actual table) Use tCloseConnection at the end. I hope this should help. Cheers! Gatha
... View more

Hi Vidya, Can you please share a screenshot of what you have got already? To get my self clear on what you want, you have a tmap's output connected to and toraclerow and would like to insert 1 and 2 values into column A and B? Am I right? If I am not right please explain. Cheers! Gatha
... View more

Hi, I just had a look at the TMap you have shared. It looks the data comes from multiple tmaps. I believe your source in the attached is an output of another tmap. Can you please share the whole screenshot of of job? Can you also share the data journey of the columns you have mapped for those 2 date columns ? What data type is the actual source of those date columns? Cheers! Gatha
... View more

Hi All, I have Talend DI and DQ 6.3 , Subscription version. Java: jdk 1.8 I would like to extract data from Omniture (Adobe Analytics) every hour. (I may not be able to use Email or FTP from Omniture - org restriction) I don't see any specific component available in the pallet. Can we use any generic components available inside Talend? If so please give me some insights. Cheers! Gatha
... View more

I guess there was a space at the end of my username, once I removed that solved the problem It would be much better if we have a test connection button in TAC to verify the Git connection details are correct. Cheers! Gatha
... View more

Hi, An attempt to send an e-mail to empty list of recipients, ignored.
channel stopped
An attempt to send an e-mail to empty list of recipients, ignored.
Finished: FAILURE Its looks like to you don't have receiver's email mentioned in the send email component. Fill that in and give it a try. Cheers! Gatha
... View more

HI, I am trying to build a job using Talend 6.3.1 Subscription version. I have a Talend job which does few database operation and output a csv file. When I try to build this one as a standalone job, I am not able to see the build zip file anywhere. It doesn't even through any error. Can anyone help me out how do I resolve this? Cheers! Gatha
... View more

Hi, I joined a new (new to me, running already) Talend project where Git used as a source control. I am using Talend version 6.3 , Subscription one. In TAC I have configured my Git credentials. In the project configuration it has got the administrator's credentials configured at TAC. I have configured the connection details in Talend Studio and after I chose the existing project there is a prompt for Git password, When I enter my password I get an error like this. What could be the reason? I have checked logging into the git website and I am able to access repository. I am able to log in TAC as well. org.talend.commons.exception.PersistenceException: Can not connect to project with url "<url>".
at org.talend.repository.remoteprovider.RemoteRepositoryFactory.delegateBeforeLogon2(RemoteRepositoryFactory.java:376)
at org.talend.repository.remoteprovider.RemoteRepositoryFactory.delegateBeforeLogon(RemoteRepositoryFactory.java:328)
at org.talend.repository.remoteprovider.RemoteRepositoryFactory.beforeLogon(RemoteRepositoryFactory.java:267)
at org.talend.core.repository.model.ProxyRepositoryFactory.logOnProject(ProxyRepositoryFactory.java:1850)
at org.talend.repository.ui.login.LoginHelper$1.run(LoginHelper.java:429)
at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:122)
Caused by: org.talend.commons.exception.PersistenceException: username or password are not correct, please check in TAC users configuration
at org.talend.repository.gitprovider.core.GitProjectUrlCheck.check(GitProjectUrlCheck.java:95)
at org.talend.repository.remoteprovider.RemoteRepositoryFactory.delegateBeforeLogon2(RemoteRepositoryFactory.java:374)
... 5 more
Caused by: org.eclipse.jgit.api.errors.TransportException: <url> not authorized
at org.eclipse.jgit.api.LsRemoteCommand.call(LsRemoteCommand.java:196)
at org.talend.repository.gitprovider.core.GitProjectUrlCheck.check(GitProjectUrlCheck.java:89)
... 6 more
Caused by: org.eclipse.jgit.errors.TransportException: <url> not authorized
at org.eclipse.jgit.transport.TransportHttp.connect(TransportHttp.java:501)
at org.eclipse.jgit.transport.TransportHttp.openFetch(TransportHttp.java:309)
at org.eclipse.jgit.api.LsRemoteCommand.call(LsRemoteCommand.java:175)
... 7 more
... View more

Hi, Think about a situation where your lookup table is bigger than the Main table, Like your example 100 records from main stream, millions of rows in lookup table in that case 100 small i/o operation is better than one huge extract which is going to take more time. I hope this helps. If you try the above example, you will have a better idea. Cheers! Gatha
... View more

Hi Deepthi, Its depends on the situation, size of the table and refresh rate of the main and look up table. if the lookup is relatively small its better to use Load Once method. There are 2 instances I can think of using reload at each row. -If the lookup table refreshes quite often if you have long running job -If you process minimal record at a time don't need to bring a big lookup table into the memory I hope this helps. Cheers! Gatha
... View more

Hi, To make my understanding clear you are extracting the data from Amazon s3 alone. (meaning not joining the data from anywhere else) Loading into which database? are you performing any transformations at this stage? Log the time in a file at each stage with stage name and find out which stage takes time. we can start tuning from there. All the jobs screen shot can help for better understanding. Cheers! Gatha
... View more

Hi, Please use the component called tflowtoiterate just after tsamplerow before tftpget In tftpget you must be mentioning the file name in the file mask row4.basename+".csv" I hope this should work. If it is doesn't work please send me a screen shot after you modified the job. Cheers! Gatha
... View more

Hi Saibabu, I strongly doubt on the parameters you are passing to create the file. Can you duplicate this job and define a hard coded a path(different from actual) and run it in the server parallel When the actual program doesn't generate a file , check the output here, you may get a clue. On the other note May I know why are you using an excel output and trying to give a csv extension? Is there any specific reason behind it? You can use toutputfiledelimited component which is to get CSV file output
... View more

Hi, I am still trying to understand the problem you want to solve. You want to have some values in election_id which you are not getting now? Or What do you want to do? I didn't get that. Cheers! Gatha
... View more

There are various factors can degrade a performance of a job 1. Data volume 2. Network Latency 3. Poor configuration 4. Poor Coding ( here comes more components, but it may not be a reason always, sometimes) Please share a screen shot of what are you trying to achieve, that will help us identify what's going on. Cheers! Gatha
... View more

Hi Rajesh, I had a similiar problem. How many rows of data have you got in the excel sheet? If it has got some VB script on the excel you may encounter this or anything other than data. If you could copy paste the whole content into the new sheet, save it and try using that file. It should work. Cheers! Gatha
... View more

Are you getting any data Aurora ? if not please remove that. Where are you seeing the componentlist (full screen of your screen shot where you don't see component list can help) Please let me know what are you trying to achieve by this job FYI- You have to create context here
... View more

Hi, tfixedflowinput is not the right component for parameters Please use context variables for passing parameters. mention context.<variable name> at the tmysqlSP component. Cheers! Gatha
... View more

Hi, tfilecount is not necessary as the tuniquerow gives you the number of unique rows by a global variable. I am able to see a tfilelist component at the front. Are you going to use multiple files? If just one file it is simple. 1. Create a tjava 2. Take a subjob ok from tfilelist component and connect to tjava. Nothing required inside tjava 3. From tjava create 2 runif connector and connect to process a and b 4. ((Integer)globalMap.get("tUniqRow_1_NB_UNIQUES")) and ((Integer)globalMap.get("tUniqRow_2_NB_UNIQUES")) is the global variable to get the unique number of rows from both the filters 5. each run if you can use the above variables to do a comparison For multiple files, I am still thinking how we can go about it. give it a try by following all steps above and taking componentok from tfileinput delimited. Cheers! Gatha
... View more

Check if any of the data is null at the source. Talend(Java) cannot handle null when it is expecting some value. use a not null filter before this step What is the data type of rowX.fieldnameX and rowX.fieldnameY? Do you want to add these two values or do you want to concatenate these 2 values? Please let me know what do you want to achieve, I can help you better
... View more

Hi, Are you executing it locally? or on a remote server. It could happen on a remote server as the connection between remote server and database server may be blocked. Are you using IP address or DNS name? if it is DNS name whether has it been added to the host file? This is the only reason I can think of. Cheers! Gatha
... View more

Hi, Please use a tSystem component and use the below link to get the file converted. https://www.ibm.com/support/knowledgecenter/SSLTBW_2.2.0/com.ibm.zos.v2r2.bpxa500/dd.htm cheers! Gatha
... View more

Hi, As far as I could see from your post Please configure the header row number, which I could see zero now. If you choose all sheets option, all sheets should be with the same format. If it's a different format, you may have to use new metadata created in talend. Cheers! Gatha
... View more

Hi, Please uncheck the option Use project Setting that will enable you to choose the check box. or go to Project setting and enable Use statistics(tStatCatcher) for all the jobs in the project Cheers! Gatha -- PS: If this works, can you please mark this as solution?
... View more

Hi, you can use tloop functionality in Open Studio 1. create a context variable as integer set the default value to 2 2. under tloop use this variable for To 3. Create a flow tloop -> trunjob 4. From trunjob onsubjob error use tjava to increment the number 5. once it is successful set the context variable to zero using tjava So that it will come out of the loop.
... View more

Hi @k526, I am not sure how the above screen shot works. from my solution (Having a tfilelist, tjava and your old program) 1. In tfilelist you can specifiy the file mask. Please set a file mask as indi_*.csv 2. Please use a set of tfilelist and tjava component for each file you have with new file mask to filter the respective files. Cheers! Gatha
... View more

I just gave some examples. It doesn't need to be that many. Even if it is many if you specify the parameters and criteria right it shouldn't give a problem. "i.e. could 2 columns be detected as 1? " This will never happen as Excel is storing each and every column in separate cells.
... View more

Hi, How many schemas have you got to compare? What is the maximum number of columns? What is the max data length possible in any column? Consider you have 10 columns max and 50 is the max length create a metadata with 10 columns with 50 character length and string as a data type. you may load that into a thashoutput and use thashinput everytime to compare in each schema type Cheers! Gatha
... View more

Hi, I guess your connection to the repository is not closed properly. Try contacting the talend administrator. They should be able to find the process connected to your user and kill it. Then you may be able to open the workspace. Cheers! Gatha
... View more

Hi @Abhi529, You may have to split the load to get this working. If your source and target are same servers(same DB software in the same physical/virtual machine), you may try using ELT components
... View more

Hi, Please follow the below steps, this might help. 1. tfilelist component and set the parameter Order by and Order action in such a way that latest file comes last. 2. Take a iterate Link from tfilelist to tjava component. 3. Create context variable for the file name. Inside tjava set the context variable to the talend varibale ((String)globalMap.get("tFileList_1_CURRENT_FILE")); 4. Take out a Onsubjob ok from tfilelist to your existing tfileinputdelimited. use the context name for the file name. Cheers! Gatha
... View more

Hi @srkalakonda, I had encountered a similiar issue. make sure your source and target files are with the same encoding. If you use UTF-8 character encoding this should not occur. Cheers! Gatha
... View more

Talend does a basic schema check at tFileInputExcel. Because it tries to store the data in the respective data type. Option1 Create a metadata with all the column as a string without any not null constraint. In the next stage, you may convert them to the respective data type(The data might fail in this step itself.). Option 2 Pls use the reject output of tFileInputExcel similar way you want to use the tSchemaCompilationCheck Cheers!
... View more

Hi, It's the default message you get after all errors "There may be some other errors caused by JVM compatibility. Make sure your JVM setup is similar to the studio." Can you please click on the Component tab and post a screenshot?
... View more

Talend does a basic schema check at tFileInputExcel. Because it tries to store the data in the respective data type. Option1 Create a metadata with all the column as a string without any not null constraint. In the next stage, you may convert them to the respective data type(The data might fail in this step itself.). Option 2 Pls use the reject output of tFileInputExcel similar way you want to use the tSchemaCompilationCheck Cheers!
... View more

Hi, I had a similiar situation. I have created reject row output on tFileInputExcel and pointed to reject file once again. Because some of the data cannot be read by Talend like floating number data and the data type is Integer, this will get rejected at This will get rejected at tFileInputExcel itself. I hope it helps
... View more

HI, All, I am using Talend Open Studio for Data Integration V 6.3 I need a help on creating a job with Oracle trigger based CDC. I am following the below documentation to achieve the same. https://help.talend.com/#/reader/_Qg2guINsDl6hsiB7uKWzQ/nnfpCC_g26JyrTImlmanZw I am using Oracle XE 11g database. I am not able to see CDC Foundation under metadata I have created. Do I need to enable anything to get that appear? Any help is much appreciated. Cheers! Gatha
... View more