filmov
tv
Orchestrating Your Data Pipelines with Apache Airflow • Ricardo Sueiras • GOTO 2022
Показать описание
This presentation was recorded at GOTO Amsterdam 2022. #GOTOcon #GOTOams
Ricardo Sueiras - Principal Advocate in Open Source at AWS & Experienced Coach & Mentor @ricardoasueiras
RESOURCES
ABSTRACT
Apache Airflow continues to gain adoption for its ability to configure data pipelines as scripts, monitor them with a great user interface, and extend their functionality through a set of community-developed and custom plugins.
In this session, Ricardo will introduce Apache Airflow and its key components and then dive into building some simple pipelines exploring these and so you can begin to get an idea of how you can use Apache Airflow to orchestrate your own data pipelines. [...]
TIMECODES
00:00 Intro
01:10 What is in your data pipeline?
02:33 Introducing Apache Airflow
12:11 Demo
18:13 Building our data pipeline demo
20:23 Demo
30:52 Apache Airflow evolution
31:48 How to contribute
32:10 Outro
Read the full abstract here:
RECOMMENDED BOOKS
#ApacheAirflow #Airflow #AWS #Orchestrating #DataPipelines #OpenSource #AirflowDAG
CHANNEL MEMBERSHIP BONUS
Join this channel to get early access to videos & other perks:
Looking for a unique learning experience?
SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
Ricardo Sueiras - Principal Advocate in Open Source at AWS & Experienced Coach & Mentor @ricardoasueiras
RESOURCES
ABSTRACT
Apache Airflow continues to gain adoption for its ability to configure data pipelines as scripts, monitor them with a great user interface, and extend their functionality through a set of community-developed and custom plugins.
In this session, Ricardo will introduce Apache Airflow and its key components and then dive into building some simple pipelines exploring these and so you can begin to get an idea of how you can use Apache Airflow to orchestrate your own data pipelines. [...]
TIMECODES
00:00 Intro
01:10 What is in your data pipeline?
02:33 Introducing Apache Airflow
12:11 Demo
18:13 Building our data pipeline demo
20:23 Demo
30:52 Apache Airflow evolution
31:48 How to contribute
32:10 Outro
Read the full abstract here:
RECOMMENDED BOOKS
#ApacheAirflow #Airflow #AWS #Orchestrating #DataPipelines #OpenSource #AirflowDAG
CHANNEL MEMBERSHIP BONUS
Join this channel to get early access to videos & other perks:
Looking for a unique learning experience?
SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
0:32:28
Orchestrating Your Data Pipelines with Apache Airflow • Ricardo Sueiras • GOTO 2022
0:08:29
Data Pipelines Explained
0:02:56
Why You Need Data Orchestration
0:03:23
What is Data Orchestration?
0:10:40
Data Orchestration 101 - Schedule & orchestrate your data pipelines with Kestra
0:02:37
Data Orchestration in data engineering
0:17:12
Orchestrating Data Pipelines With Snowpark dbt Python Models And Airflow
0:00:52
When do you need data orchestration?
0:02:02
Fastest Way to Orchestrate Your Data Pipelines with AWS
0:12:10
Orchestrating Data Movement | DP-203 | K21Academy
0:10:34
What is Data Pipeline | How to design Data Pipeline ? - ETL vs Data pipeline (2025)
0:02:54
What is data orchestration? | The Data Pinch Ep.28
0:06:16
Automate Data Pipeline Orchestration | Episode 5 | The Essential Toolkit for Data Warehousing
0:58:57
Orchestrating Data Pipelines with Apache Airflow on Azure
0:07:55
How to build a data pipeline with Google Cloud
0:00:17
Data Engineering: Building a Platform to Support Orchestration Across Teams.
0:57:10
Paul Andrew - Azure Orchestration - Applying Data Factory in Production
0:53:56
Intro To Data Orchestration With Airflow
0:48:30
Orchestrating Hybrid Workflows with Apache Airflow
0:23:32
How to orchestrate your data pipeline using automation to save time, money and build resilience.
0:16:40
The Future of Data Orchestration: Asset-Based Orchestration
0:43:50
Orchestration of data pipelines using airflow
0:02:44
Data Pipeline Orchestration for DataOps by Stonebranch
0:22:28
Orchestrating ELT with Fivetran and Airflow
Комментарии