DP-203: 13 - Azure Data Factory integration runtimes (part 2)

Hey data engineers! In my last video I talked about two ADF integration runtimes, including the super cool one - Azure IR with managed virtual network. However, none of them allows us to install anything on them and sometimes it is required when we just need to have some particular ODBC driver installed or a client certificate available.

In this video I'm talking about two remaining ADF integration runtimes, and yes - one of them gives us the full control and flexibility. Also, I'm showing the way to connect to on-premises environment from Azure Data Factory. Finally, I summarize the episode by giving you some guidelines you can follow when deciding which integration runtime to use.

Enjoy!

▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬

▬▬▬▬▬▬ MEMBERSHIP ▬▬▬▬▬▬
Join this channel to get access to perks:

▬▬▬▬▬▬ CHAPTERS ▬▬▬▬▬▬
00:00 Introduction
01:45 Azure-SSIS integration runtime
03:35 Self-hosted integration runtime
31:51 How to choose proper iR?

[HamzaBray]

Networking is simply explained in context of Azure Data Factory Pipelines!!
Thank you Piotr ❤

[patrickdonahue]

These videos are awesome! Concepts are explained very clearly. Thank you!!

[karthikeyans]

I found this gem recently. I am on the way in this series. Thank you so much for your videos. Appreciate your help in making this videos.

[shraddhachoudhary]

Complicated Networking topic explained in very simple way. Thanks for your efforts.

[maxirojo]

hello! thanks for the excellent videos. They help me a lot to understand the cloud and the fundamentals of data engineering in the Microsoft cloud. If I have two virtual machines and in each of them I install the same version of integration runtime, would configuring a single integration runtime in datafactory be okay? Can I use the same authentication key on both virtual machines?

[mdpdurawix]

Does private endpoint needs to be monitored? Or authentication keys should be rotated after some period of time?

[rafaelvieira]

we use here shir to connect to aws data sources

[benhodes]

how many are in the series for whole of DP203