34 Load data in batches from one server to another server in SSIS

Load data in batches from one server to another server in SSIS
Download the file\script used in the Video from below link

Load data in batches from one server to another server in SSIS
How do I import data from one server to another in SSIS?
How do I load multiple files in SSIS?
How do I copy a SSIS package from one solution to another?
How do you do batch processing in SSIS?

Happy Learning.

[SamAlexander]

For a static table where you have ability to alter source this is viable, but for a table that could change during load or you can't alter source this won't work. Best to split the source into smaller chunks by primary key.

[rprasad]

Hi Aqil, Thank u very much for considering my request and making this video.

[deepakj]

Hi Aqil, Excellent video, Thank you !!
Can we use 'Maximum insert commit size' property of OLE DB destination to do batch processing.

How to improve SSIS performance using 'Maximum insert commit size' property?
Can you pls tell me other different methods to do batch processing?

[reddyabhik]

super! Well explained on batch loading to destination

[khabir]

This video is excellent but unfortunately i can't implement simply because I only have a SELECT privilege on my source so I cannot create the part column. My source has over 50 million rows. I spool effortlessly sometimes but the data keeps growing and I will soon be out of memory. Is there a method I can use that will not require me to create the part column?

[romi]

You have mentioned that you will make a video for data migration with optimize way... I have been waiting for long time.when can I get it.Thanks alot

[khadeerrazvi]

I have a request to create a video on how to load multiple Xml files from sftp server to Sql server. please consider my request & make a video on this.

[sumankumar-ddvq]

Instead can we not use fastload in OLEDB destination and set the maxrowsperbatch / max commitsize to do the same. which of these is better?

[markmanalo]

Hi Aqil!
Can you make an SSIS package where you are going to extract data on SQL Server Database to excel per 1 million rows.
Like for example: 2.6 million rows will be extracted on 1 excel file with 3 sheets. The first 2 sheet will be 1 million and exceeding data (600k) is on the third sheet.
Or maybe instead of sheet. you will extract it to multiple excel files applying the logic there.

[tejaskurle]

I want to transfer million data into batches from Table A to Table B. Table A, B both are inside the same database. What would be the query?

[SriramChandu]

Hello Aqil,

Can you please make a Video on below.
1. Create SSIS package for initial load till a particular date, For example: if we have data from 01/01- 13/06 in source, for 1 offload. I want to load data till only 01/06. The remaining Data should be loaded through the incremental load.
2. Can you please show how to transfer a file using SFTP protocol using SSIS. I tried using WinSCP and FileZilla but it didn't work.

Thanks in Advance