filmov
tv
30. a) Incremental load part 1
Показать описание
Hello Everyone,
Hope you guys are doing well. Stay safe.
This video will walk you through the incremental load in Qlik Sense.
This is part-1 of incremental Load.
Definition: Loading the new /updated records without loading the full data is called Incremental load.
Points to remember:
1. There are two QVDs
a) Full QVF: Which runs ones in gap so as to load the full data including the historical data as well.
b) Incremental QVF: Which Runs every regular intervals so as to merge the new/updated records
2. There is no key words used it is purely logic based
Why we do incremental Load: Suppose you have a Huge data which takes hours to load. We shouldn't be loading the full data , specially when there is minor or no change in historical data.
So, it is recommended to load the newer record in specific intervals.
Full Load can be done ones in a while depending upon the requirement.
In The Part-1 we are doing Insert-Update Incremental Load where new newer records gets uploaded in regular intervals and the change in the Historical data will be taken care by Full load (which Runs in a while).
Please find the code attached for better understanding.
Link for the Document:
Note: (Document is for briefs, not for the detail description)
Please follow me on:
Thank You
Hope you guys are doing well. Stay safe.
This video will walk you through the incremental load in Qlik Sense.
This is part-1 of incremental Load.
Definition: Loading the new /updated records without loading the full data is called Incremental load.
Points to remember:
1. There are two QVDs
a) Full QVF: Which runs ones in gap so as to load the full data including the historical data as well.
b) Incremental QVF: Which Runs every regular intervals so as to merge the new/updated records
2. There is no key words used it is purely logic based
Why we do incremental Load: Suppose you have a Huge data which takes hours to load. We shouldn't be loading the full data , specially when there is minor or no change in historical data.
So, it is recommended to load the newer record in specific intervals.
Full Load can be done ones in a while depending upon the requirement.
In The Part-1 we are doing Insert-Update Incremental Load where new newer records gets uploaded in regular intervals and the change in the Historical data will be taken care by Full load (which Runs in a while).
Please find the code attached for better understanding.
Link for the Document:
Note: (Document is for briefs, not for the detail description)
Please follow me on:
Thank You
Комментарии