How to Pass Data Between Tasks in Airflow

preview_player
Показать описание
In this video I'll go through ever possible way I know of to pass data between tasks, whether they are Traditional Operators or TaskFlow API Tasks! Check out the repo below if you want code examples for any of these methods!

  1. The Data Guy
Рекомендации по теме
How To Pass 0:18:52

How To Pass Data Between View Controllers in Swift (Xcode 11) | iOS for Beginners

How to pass 0:10:39

How to pass data between sibling components in React | Lifting up state | Easiest way

Pass Data Between 0:05:04

Pass Data Between Screens in a Canvas App | Working with Galleries, Forms and Global Variables

How to Pass 0:12:25

How to Pass Data between Client & Server using JSON!

How to Pass 0:15:55

How to Pass Data Between Scenes in Godot (Building a Level Switcher #3)

Pass Data Between 0:10:27

Pass Data Between Windows - PyQt5 GUI Thursdays #25

Pass a Variable 0:12:24

Pass a Variable Value from One HTML Page to Another

Python Tutorial: How 0:02:07

Python Tutorial: How to pass data between functions

SWIFT UI Basic 0:10:20

SWIFT UI Basic Explaination

How to Pass 0:20:48

How to Pass Data Between Tasks in Airflow

Best Way of 0:07:54

Best Way of passing Values between mutliple JFrames | Pass Data from one JFrame to another Java

Next.js Pass Data 0:07:19

Next.js Pass Data From One Page to Another Page

Pass Data Between 0:03:28

Pass Data Between Blocks | Postman Flows

React JS Tutorial 0:18:54

React JS Tutorial [2023]: How to pass data between pages - Params, Props, and Context

Pass data between 0:17:17

Pass data between destinations by Navigation Component

How to Open 0:03:05

How to Open & Pass Data Between Forms in MS Access - Easy VBA Tutorial

How To Pass 0:14:10

How To Pass Data from One ViewController To Another ViewController In Swift IOS

Vue.js 3 | 0:01:48

Vue.js 3 | Understanding How to Pass Data From Child to Parent With Emit Function

R Tutorial : 0:03:23

R Tutorial : How to Pass Data Between Functions in r

How to Pass 0:00:53

How to Pass Data Between Components In ReactJS

How to pass 0:05:40

How to pass data between one form to other form in visual studio windows form application 2019

How to pass 0:12:26

How to pass variable one page to another page or same page | JAVASCRIPT | HTML | TutorialSpot

How to Easily 0:05:32

How to Easily Pass Data Between Pages in Flutter App

How to Pass 0:05:58

How to Pass Data From One Component to Another Component in REACT JS - REACT JS Pass Data

Комментарии
Автор

If you have a DAG A that triggers DAG B via-Datasets, can DAG B get information from DAG A? such as run_id or other custom information, like for example, DAG A's Task1 proccessed CSV files [example1.csv, example2.csv[

kazaki
Автор

hi George, nice video
I am looking for a way to pass an json, yaml or some way to pass the configurations to dag.
And then should be able to read those values, overwrite in task and then get the updated value of that variable/config in another task of same dag
However I dont want to use xcom or variables. Is there any way to handle this? PLease let me know

thepakcolapcar
Автор

How can I pass a csv (small) between tasks?

ornachshon