Orchestrate SQL Data Pipelines with Airflow | Schedule SQL scripts with Airlfow | ETL with SQL

In this video we will cover how to run and schedule SQL scripts with Apache Airflow. This is one of the common use cases for Apache Airflow. We can run scheduled SQL scripts.
We will learn how to schedule a SQL script using Airflow, with an example. Let’s assume we want to run a SQL script every day at10 AM. This SQL script denormalizes multiple products tables into a single dimension. This produces a single product dimension for data analysis.

#airflow #etl #sql

💥Subscribe to our channel:

📌 Links
-----------------------------------------
#️⃣ Follow me on social media! #️⃣

-----------------------------------------

Topics covered in this video:
==================================
0:00 - Introduction to SQL Orchestration
0:22 - SQL Script
0:53 - Create Airflow DAG
1:41 - SQL file Path
1:59 - How to run SQL files
2:37 - Execute the DAG
3:07 - Test DAGs Outupt

[BiInsightsInc]

Link to previous Airflow videos & DAG:

[rafaelg]

great! is that pure sql (like airbyte?) or using dbt as well?