SSIS Tutorial Part 71-How To Redirect or Remove Duplicate Records in Data Flow Task in SSIS Package

In this video you will learn how to remove or redirect duplicate records in data flow task by using Aggregate Transformation with Conditional Split Transformation in SSIS Package.

This video also covers
How to create an SSIS Package
How to use Data Flow Task in SSIS Package
How to use Aggregate Transformation Transformation to remove duplicate records in SSIS Package
How to use Conditional Split Transformation in SSIS Package to redirect Duplicate records
How to read flat file in SSIS Package
How to Load Data in SQL Server Table by using OLE DB Destination Transformation in SSIS Package

To follow Step by Step SQL Server Integration Services(SSIS) Video Tutorial By TechBrothers, please open below link.

[krismaly]

I enjoyed watching this video and recommend others to watch.

Thanks for educating the community and appreciate your efforts

[ottmiller]

Thank you Aamir and your bother. I watched most of your videos. I found your explanations to be lucid and concise.

[johngay]

what if I want the non-duplicates and 1 of the duplicate records - discarding all others. So in your example I would have wanted 1, 3, and 4 as unique records.

[rorymcmanus]

What if I only want to do a count on the ID field? The columns are not passed through missing e.g. FirstName, Last name etc

[praveensukabrahmam]

What if I want to split the duplicate rows based on duplicate values in only one of the columns and not the whole row?