Azure Data Factory, Azure Databricks, or Azure Synapse Analytics? When to use what. – Lisa Hoving

Have you ever found yourself at the start of a data (engineering) project, unsure about what tool to choose? Speak no more! In this session we will discuss three often used (data engineering) tools on Azure:

- Azure Data Factory
- Azure Databricks
- Azure Synapse Analytics

First, I will give a brief introduction to each tool, including for what use cases they are commonly used. Next, we will talk about what makes these tools different, and where they overlap (and believe me, they do). Lastly, we will arrive at our conclusion: when to use what. Of course, a slide on differences in costs will be included as well.

Lisa is a friendly Data Engineer from the neighbourhood. Her background comes in Finance, but she has had the pleasure to be working in IT for the past 5 years. At Intercept, she helps customers in migrating their data applications to the Azure cloud.

[jyotirdas]

very nicely explained, thankyou so much...

[TeferiHagos]

One of the best YouTube videos I have ever watched. Now, I understand the difference between these 3. Great job, teacher!

[geojbarros]

I did love your explanation about the differences between these three environment, Lisa. It clarified a lot of doubts that I had in my mind about it. Thanks a lot.

[carloscantu]

Just the content I was looking for, thanks for sharing in such a clear and concise way!

[datacraftersrd]

Awesome explanations. Thanks, Lisa Hoving

[wasimx]

Thank you for sharing It really helped me to understand the difference between these 3 ☺️☺️

[davidk]

Thank you Lisa, that was essentially a master class on the differences. Excellent. How does Snowflake compare? (separate video probably and also depends on the use case of course). Thank you again for this information. Job well done.

[bijosn]

Hi, my name is Henk, nice to meet you

[dans]

Isn't it true now that it's not necessary to know Spark for Databricks? I thought the transactional layer abstracts away the need to write Spark code and instead provides options to use SQL or Python.

[saktibiswal]

Isn't Intercept a pharma company?

[EMoscosoCam]

What about using a VM with SSIS inside? Thanks.

[dans]

Isn't it true now that it's not necessary to know Spark for Databricks? I thought the transactional layer abstracts away the need to write Spark code and instead provides options to use SQL or Python.