How to Save Money Using Airflow’s Asynchronous Azure Operators

preview_player
Показать описание
This “Live with Astronomer” session covers how to implement the asynchronous Azure operators from the Astronomer Providers package to orchestrate a pipeline with long-running Azure Databricks and Azure Data Factory jobs. Using asynchronous Azure operators brings cost savings and better scalability when compared to traditional operators.

Questions covered in this session include:
What is the Astronomer Providers package and how do I install it?
How can I implement asynchronous operators in my existing DAGs?
How do asynchronous operators help when orchestrating Azure Databricks and Azure Data Factory tasks?

Рекомендации по теме
Комментарии
Автор

Thank you so much for sharing this with us on YouTube

sabaokangan