incrmental load

Hi

I have a requirement like below. I have an QVD which is 3 months data till yesterday and daily I will get an excel file as a data and it will be override on daily base with the new data. Now here is situation for me

I want add data to existing QVD with the new data on daily basis.Suppose if I get an excel data today, it has to check November month QVD data and with ID columns(there time stamp or modified date column) and replaced with new data. In the same way if I run this load on December it has to check only December data and modified with excel data.

Re: incrmental load

Re: incrmental load

Thanks again for sharing valuable information. Here in my QVD I don't have date column and one more thing it has to check the qvd data on monthly wise. I mean if you run in November month it has to check to check November data and modified that data. If run in December it should check in December and adds to that QVD file.

In my QVD I have columns data like

yearmonth location ID

201509

.

.

.

201511 US 1

201511 UK 2

201511 AUS 3

Suppose today i got excel like

yearmonth location ID

201511 HKG 1

My final output should be like

yearmonth location ID

201509

.

.

.

201511 HKG 1

201511 UK 2

201511 AUS 3

So US is replaced with HKG.

So if I run QVD script in December with new data it has to check with December QVD data and any changes are there in QVD it has to modified and should create final QVD.

Re: incrmental load

Hi Mohammad,

Thanks for sharing valuable information. My requirement is not like incremental load. Here it it should modify only current month records and it should not modify any records withe same id in previous months records.