Why You Need Data Orchestration

preview_player
Показать описание
What is data orchestration and why do you need data orchestration for your ETL pipelines? Is apache airflow the only option, or are there other orchestration tools to consider for your data pipelines?

⏯RELATED VIDEOS⏯

________________________________________________

________________________________________________

🎓Data courses (Not Produced by nullQueries)🎓

________________________________________________

📷VIDEO GEAR📷

💻VIDEO SOFTWARE💻
________________________________________________

Some of the links in this description are affiliate links and support the channel. Thanks for the support!
  1. nullQueries
  2. data orchestration
  3. big data
  4. data engineering
  5. data pipeline
  6. pipeline orchestration
Рекомендации по теме
Why You Need 0:02:56

Why You Need Data Orchestration

What is Data 0:03:23

What is Data Orchestration?

When do you 0:00:52

When do you need data orchestration?

What is data 0:02:54

What is data orchestration? | The Data Pinch Ep.28

What Problems does 0:02:19

What Problems does Data Orchestration Solve?

Data Orchestration in 0:02:37

Data Orchestration in data engineering

Modernize Data Orchestration: 0:05:10

Modernize Data Orchestration: Autosys to Cloud Composer

What is data 0:00:54

What is data orchestration?

Data Engineering 101: 0:27:04

Data Engineering 101: Build Resilient Pipelines

Dagster Data Orchestration 0:10:28

Dagster Data Orchestration 10 min walkthrough

Who is Data 0:04:13

Who is Data Orchestration For?

What is eCommerce 0:02:20

What is eCommerce Data Orchestration?

Data Orchestration: Power 0:02:22

Data Orchestration: Power your Data Value Chain

Explainer: What is 0:01:26

Explainer: What is Openprise Data Orchestration?

Which Data Orchestration 0:10:05

Which Data Orchestration Tool Will DOMINATE in 2025?

Modernize Data Orchestration 0:04:06

Modernize Data Orchestration with Cloud Composer

Data Orchestration Demystified: 0:06:10

Data Orchestration Demystified: A Beginner's Guide

Revolutionizing Data Orchestration 0:04:05

Revolutionizing Data Orchestration with Workflow Builder

Modern Data Orchestration 0:23:09

Modern Data Orchestration | Astronomer Co-Founders Pete DeJoy & Viraj Parekh

Data orchestration for 0:16:03

Data orchestration for AI, big data, and the cloud

The Future of 0:16:40

The Future of Data Orchestration: Asset-Based Orchestration

We need an 0:01:20

We need an orchestration layer in the data stack (Ethan Aaron)

How to Achieve 0:00:54

How to Achieve Harmony with Data Orchestration in less than 60 seconds

What Is Data 0:10:56

What Is Data Orchestration—and Why It Matters in Fraud Prevention

Комментарии
Автор

Awesome video. Minor nitpick: the D in DAG is “directed” as in directed arrows. (End nitpick.) As popular as data engineering is getting, it’s really hard to find conceptual videos like this on the basics.

BenOgorek
Автор

This is one of the best channels for data engineering. good visuals and easy explanation thanks sir!

rutvikkachchhi
Автор

i still don’t understand how this channel isn’t fucking massive

andrew
Автор

Question. Have you used airflow before on a project? I think it makes a lot of sense if you want to build everything from the ground up, but with so many great replication transformation streaming tools that most companies have purchased I haven't had to use it yet.

TheRyalBeast
Автор

Many thanks for your videos! Question - how would you orchestrate jobs and dependencies between data products in a data mesh? Would Airflow handle this from a central point or is there a more decentralized way of handling this? Any guidelines or ideas that you could share? Thanks.

davorvukovic
Автор

Yikes! Dims getting loaded after the fact? 😮

sarahseils