01 Incremental load in SSIS using Lookup transformation | SSIS real time scenarios

Incremental Data Load in SSIS
Download the file\script used in the Video from below link
Below is a faster way to implement incremental data load in SSIS

incremental data load in ssis
What is full load and incremental load in SSIS?
How many ways we can do incremental load in SSIS?
How do you load incremental data?
How incremental load is implemented in SQL?

Happy Learning.

[Shri-RAM-JaiBajrangBali]

Hi Aakil, I want to say thanks from the bottom of my heart, I got the job, I saw all your videos

[romariovargas]

Thanks for taking your time to do this, I'm a newbie starting ssis. Greetings from Lima, Peru

[zaheershaikh]

Akheel! MaShaAllah great job buddy keep it up. I appreciate your effort towards the beginners. Thanks a lot.🏆

[muzammalhussainjanjua]

Dear Akil brother you are a living legend. I have wathced your every video to learn SSIS.
Please do me a one favour, if someone wants to see whcih records got updated and which records got deleted what will be the logic behind it? Hearing from you. Thanks

[reddyabhik]

I really appreciate the effort you put for realtime scenario examples. You are amazing.!
If possible could you please extend below 2 tasks to this Incremental load video.
1. Delete task: for the deleted records on the Flat file.
2. Difference between SCD vs Lookup Transformation.

[gauravtiwari]

Hello Akil,
Your playlist is amazing!

Just a small question, why did you just ticked the column names in conditional split tile and not map them with corresponding input dataset as shown at 13:53?

[NebroProg]

Dear Ahmed,

I hope you are well,

I have a little bit suggestion,
can you create topics about data as general, for example:

- Data guards.
- Data marts.
- Data leeks.
- ODS.

etc...

and create a complete project cover all these topics.

It will be absolutely great!

Best regards.

[easyyuz]

Hi Aqil, I apprreciate your videos as quite many other folks here. Maybe it's irrelevant, but could you please do a video on formatting tricks that you use in SQL also to speed up scripting?

[ggolub]

Please disregard, I found the issue: Lookup transformation needs to have link between id's, not between last_name/email and dest ...
Thanks again for the great video.

[BTECH]

While executing log table creation is showing error. Showing unknown object a in execution results. Why

[outatime]

I'm new to SSIS, got a few questions:

9:36 - why did you put a question mark?
9:52 - why zero in the parameter name?

[MVinodKumar-tttu]

Hello Sir,
Here we didnt use OLE DB Command bcz it takes lot of time so this is the other approach?.
And also is there any video using OLE DB Command for incremental Load sir?

3:- Can't we use the insert query of Audit_log table in Expressions in the Execute SQL Task sir?
4:- Sir, in the insert statement for Audit_log for recordsinserted column we used '?'. and we mapped the variable with parameter mapping. So, then how is the '?' is linked with recordsinserted variable?. Like wherever the '?' is used there this parameter value is assigned to it sir? AM i correct.
5. Sir, we changed email and last_name columns alias in lookup so will that be alias only used in lookup and not when inserting updated records?

[Shri-RAM-JaiBajrangBali]

Hi Aakil, i have one query, suppose i have 10 files and want to upload in SQL and using foreach loop container and 9the file or any file have an error(might have some junk data) so how to skip that file and upload rest files,
Please capture invalid file in another location or capture the name so that after ssis packge execution, we can correct it or modify it.
please reply as this question i faced in an Interview..

[sindujasureshkumar]

your videos are the best. Very useful for interviews .. Thanks alot.. can you share a video to upload a document in sharepoint from SSIS ?

[chenchugurram]

Does this method work in case if Data is coming from CRM- D365 database ?

[vankadarinikhil]

Hi Aqil: I have one question, How can we create columns and tables dynamically from flat file source and loads in SSIS package

[RFA]

Sir as we are already using execute sql and telling ti to create zz table then too why do we have to create zz table manually in sql server. is there no workaround which is dynamic?

[dave]

HI. I miss something. Instead of Inserting the mis-matched records to table: ZZ_email_updates, why could not make update directly to the Email table.
(of course after doing compare that data have changed)
Is it because time reason for big data?
Because it should be working.

[andreicostin]

Hello sir, hope you`re good today .

i`ve got a question, through the process i`ve occurred some error at the end, it says that the process it`s ok but i have one failure:
"Truncation may occur due to inserting data from data flow column "gender" with a length of 50 to database column "Gender" with a length of 1." I would gladly be grateful if you know how can i solve this problem.

[vankadarinikhil]

Hi Sir- in Excel destination file i have two sheets data available so, want to update the records only in sheet2 using SSIS.

Can you please help me in this