Apache Airflow for Data Science #5 - How to Run Tasks in Parallel

Build a Data Pipeline (DAG) in Apache Airflow that makes four GET API requests in Parallel.

00:00 Introduction
00:58 REST API overview and DAG boilerplate
03:06 Write the Airflow DAG
09:10 Test the Airflow DAG (Sequential)
10:18 How to run Airflow DAG in Parallel
12:58 Outro

FOLLOW BETTER DATA SCIENCE

FREE “LEARN DATA SCIENCE MASTERPLAN” EBOOK

GEAR I USE