Data Factory Tutorial - How to create your first pipeline

preview_player
Показать описание
Learn how to create your first pipeline in Azure Data Factory in this Data Factory Tutorial. I explain how to copy data from Data Lake Storage into an SQL Database. In the video I talk through how to setup Data Factory, configure linked services and datasets and finally the pipeline.

If you would like to follow along with the video you can copy and paste the below in to a file and save as CSV:

Firstname,Lastname,DOB
Tony,Fellows,19/07/1984
Christine,Burt,25/02/1967
Patricia,Martins,07/12/1979

Scripts to grant Data Factory access to SQL Database:
-- create login in master database
CREATE LOGIN [datafactory] WITH PASSWORD = 'd4t4f4ctory123!';
GO

-- create user in database
CREATE USER [datafactory];
GO

-- add user to role in database
ALTER ROLE db_owner ADD MEMBER [datafactory];
GO

-- create target table
CREATE TABLE dbo.Customers
(
FirstName VARCHAR(50) NULL,
LastName VARCHAR(50) NULL,
DOB VARCHAR(50) NULL
);

-- query table
SELECT
*
FROM dbo.Customers;
Рекомендации по теме
Комментарии
Автор

Please Upload more videos regarding Azure and Data Engineering tasks

abdulbaqui
Автор

Thank you so much for putting this together! My final project for one of my classes is to build a data pipeline and this made way more sense than any of the microsoft learn articles did. You did an amazing job, please continue making videos!!! :)

boysenberrytoast
Автор

Very interesting topic! Would love to know more about data pipelines. Is there a way to reach out if we have a career specific question? Thanks!

alno
Автор

is there a way to set the username and password of the sql server through the azure sql ui ? and then just use those credentials to login through data factory without using sql server manager ?

idoreshef