SSIS Tutorial Part 73- How to Load Unique Records From Flat File by using SSIS Package

In this video you will learn how to load unique records from flat file by using aggregate transformation in SSIS Package.

The video covers following items
How to create an SSIS Package from Scratch
How to read the data from Flat file by using Flat file source in SSIS Package
How to use Aggregate Transformation in SSIS Package to remove duplicate records
How to use Aggregate Transformation in SSIS Package
How to load data into SQL Server Table by using OLE DB Destination
How to use Data Flow Task in SSIS Package to read text file and load to SQL Server Table

To follow Step by Step SQL Server Integration Services(SSIS) Video Tutorial By TechBrothers, please open below link.

[krismaly]

I enjoyed watching this video and recommend others to watch.

Thanks for educating the community and appreciate your efforts

[johnconnor]

Thank you very much! That was a great tutorial

[gurungoracle]

Tech brothers I am trying to import a huge flat file into a sql server. It errors out after loading pass 30, 000 records. When I physically split the files into two and load it two different times, it imports fine without any error. I also try to import from the flat file to a flat file. That worked fine as well.  Tech Brothers, is there  at the sql end? Any help is appreciated

[archanasriram]

I have created a similar package with the same data and ran the package, it is not taking any duplicate values.
But i later updated the text file new rows and re-ran the package, when i do that it is inserting the rows that have already been inserted thus creating duplicate records in SQL table, can you please suggest how to avoid that

[danieljoubert]

Thanks, Please share source file next time, Had to manually create 1.