Load data from Azure Blob to Snowflake using Azure Data Factory

Load data from Azure Blob to Snowflake using Azure Data Factory
This video outlines how to use the Copy activity in Azure Data Factory and Azure Synapse pipelines to copy data from and to Snowflake, and use Data Flow to transform data in Snowflake. For more information, see the introductory article for Data Factory or Azure Synapse Analytics.
nowflake is cloud based lightening fast data warehouse. It has gained lot of traction since its launched. Many organizations are moving towards the snowflake and hence there is need to do shift and load, migrate their existing data from on-premise and cloud databases to snowflake. In this article we will see various ways through which we can migrate the data to snowflake using the Microsoft Azure Data Factory.

There are two ways to connect azure data factory with snowflake

1. Create the adf pipeline with copy activity having the sink dataset created using the snowflake connector provided by azure data factory.

2. Connect to azure blob storage by creating stage in Snowflake and use snow pipe to move the data to snowflake data warehouse table.

Let’s dive into both the approach in detail and see how can you integrate step by step using the example.

Scenario: Assume that we have a csv file available which is stored in azure blob storage. We need to load the csv file data in to a table in snowflake.

Please follow and ask any question to our linkedin profile and twitter or our web site and we will try to help you with answer.
Linkedin
twitter
website
FB

Here Group of People are sharing their Knowledge about Software Development. They are from different Top MNC. We are doing this for community. It will help student and experience IT Pro to prepare and know about Google, Facebook, Amazon, Microsoft, Apple, Netflix etc and how these company works and what their engineer do.
They will share knowledge about Azure, AWS , Cloud, Python, Java,.Net and other important aspect of Software Development.

Please follow and ask any question to our linkedin profile and twitter or our web site and we will try to help you with answer.
Linkedin
twitter
website
FB

Here Group of People are sharing their Knowledge about Software Development. They are from different Top MNC. We are doing this for community. It will help student and experience IT Pro to prepare and know about Google, Facebook, Amazon, Microsoft, Apple, Netflix etc and how these company works and what their engineer do.
They will share knowledge about Azure, AWS , Cloud, Python, Java,.Net and other important aspect of Software Development.

[sujatanahak]

My Target Is ADF Agent should create the table in snowflake and then insert the data into table. How can i achieve it?

[NitinKumar-owyr]

Why, we need to migrate the data from azure to snowflake..?

[tumshukurumhalila]

Thanks, this is what I have been looking for. Do you have a video on how to automate the process? Example: scheduling at least once a week.

[revjr]

Hi I am having "\" in end of my data so those rows are getting skipped Is there any way to overcome thiz???

[sanishthomas]

what is the benefit of loading data into Snowflake tables and DB rather than SQl DB or snypasE?

[sidsam]

Hi i have 1st row as header how to do so then?

[Fat_to_Fit_Sid]

How to load SQL Server table using ADF to Snowflake. Can you please make video on it.

[joejoe]

Thanks for the video. Next time please read the buttons instead of calling them "this one" ;)

[btrade]

is it possible to load data from multiple csv files?

[azhi]

Step 1 you loaded to stage table
Step 2 stage to main table. Con you confirm. Something is not clear and confusing